-- Logs begin at Sat 2022-06-04 20:01:18 UTC, end at Sat 2022-06-04 22:16:40 UTC. -- Jun 04 20:43:09.005803 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Jun 04 20:43:12.714977 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=130277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 20:43:12.715684 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=130277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 20:43:13.143087 ncdv-master-1 cinder-volume[130277]: INFO dbcounter [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Registered counter for database cinder Jun 04 20:43:13.164674 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:43:13.174505 ncdv-master-1 cinder-volume[130277]: DEBUG dbcounter [-] [130277] Writer thread running {{(pid=130277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:43:13.489543 ncdv-master-1 cinder-volume[130277]: INFO cinder.rpc [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 04 20:43:13.495411 ncdv-master-1 cinder-volume[130277]: INFO cinder.rpc [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 04 20:43:13.504424 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:43:13.587922 ncdv-master-1 cinder-volume[130277]: INFO cinder.volume.manager [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Determined volume DB was empty at startup. Jun 04 20:43:13.588703 ncdv-master-1 cinder-volume[130277]: DEBUG cinder.volume.manager [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Cinder Volume DB check: vol_db_empty=True {{(pid=130277) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Jun 04 20:43:13.598281 ncdv-master-1 cinder-volume[130277]: INFO cinder.volume.manager [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 04 20:43:13.599148 ncdv-master-1 cinder-volume[130277]: WARNING stevedore.named [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 20:43:13.599763 ncdv-master-1 cinder-volume[130277]: WARNING castellan.key_manager [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 20:43:13.601014 ncdv-master-1 cinder-volume[130277]: WARNING cinder.keymgr.conf_key_mgr [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 20:43:13.617965 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:43:13.623374 ncdv-master-1 cinder-volume[130277]: INFO cinder.rpc [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 04 20:43:13.627911 ncdv-master-1 cinder-volume[130277]: INFO cinder.rpc [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Jun 04 20:43:13.628601 ncdv-master-1 cinder-volume[130277]: WARNING stevedore.named [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 20:43:13.629010 ncdv-master-1 cinder-volume[130277]: WARNING castellan.key_manager [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 20:43:13.630776 ncdv-master-1 cinder-volume[130277]: INFO cinder.volume.manager [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Image-volume cache enabled for host ncdv-master-1@ceph. Jun 04 20:43:13.637150 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:43:13.660651 ncdv-master-1 cinder-volume[130277]: INFO oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Starting 1 workers Jun 04 20:43:13.667317 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Started child 130490 {{(pid=130277) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jun 04 20:43:13.668683 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Full set of CONF: {{(pid=130277) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jun 04 20:43:13.669218 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ******************************************************************************** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 20:43:13.669672 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] Configuration options gathered from: {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 20:43:13.670294 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 20:43:13.671454 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 20:43:13.671909 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ================================================================================ {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 20:43:13.672852 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] allow_availability_zone_fallback = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.673486 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] allow_compression_on_image_upload = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.674282 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] allowed_direct_url_schemes = [] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.674795 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] api_rate_limit = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.675394 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] auth_strategy = keystone {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.676097 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] az_cache_duration = 3600 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.676650 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_availability_zone = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.677222 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_host = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.677727 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_name = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.678255 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_stats_polling_interval = 60 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.678780 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backup_api_class = cinder.backup.api.API {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.679325 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.679899 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backup_name_template = backup-%s {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.680719 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backup_use_same_host = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.681466 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backup_use_temp_snapshot = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.681992 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] chap_password = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.682527 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] chap_username = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.683055 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.683191 ncdv-master-1 cinder-volume[130490]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0) Jun 04 20:43:13.684400 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cinder_internal_tenant_project_id = 36edf7db2659419aa39f259141009a4a {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.684954 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cinder_internal_tenant_user_id = 57831f8b23c243ff9223b08588949da4 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.685495 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cloned_volume_same_az = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.686110 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cluster = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.686789 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] compression_format = gzip {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.687346 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] compute_api_class = cinder.compute.nova.API {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.687993 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] config_dir = [] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.688440 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.688959 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] config_source = [] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.689469 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.690032 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] control_exchange = openstack {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.690848 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] debug = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.691558 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] default_availability_zone = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.692057 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] default_group_type = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.692902 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.693447 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] default_volume_type = ceph {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.694103 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] driver_client_cert = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.694695 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] driver_client_cert_key = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.695204 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] driver_data_namespace = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.695728 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] driver_ssl_cert_path = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.696500 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] driver_ssl_cert_verify = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.697169 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] driver_use_ssl = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.697707 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] enable_force_upload = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.698154 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] enable_new_services = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.698649 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] enable_unsupported_driver = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.699176 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] enabled_backends = ['ceph'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.699765 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] enforce_multipath_for_image_xfer = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.700285 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] filter_function = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.700686 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] glance_api_insecure = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.701212 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] glance_api_servers = ['http://10.222.0.18/image'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.701728 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] glance_api_ssl_compression = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.702068 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] glance_ca_certificates_file = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.702524 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] glance_catalog_info = image:glance:publicURL {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.703014 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] glance_certfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.703461 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.703842 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] glance_keyfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.709987 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] glance_num_retries = 3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.709987 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] glance_request_timeout = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.709987 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] goodness_function = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.709987 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] graceful_shutdown_timeout = 5 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.709987 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] group_api_class = cinder.group.api.API {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.709987 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] host = ncdv-master-1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.710493 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] iet_conf = /etc/iet/ietd.conf {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.710493 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] image_compress_on_upload = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.710493 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] image_conversion_address_space_limit = 1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.710493 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] image_conversion_cpu_limit = 60 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.710493 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.710493 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] image_conversion_disable = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.710891 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] image_upload_use_cinder_backend = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.710891 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] image_upload_use_internal_tenant = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.710891 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] image_volume_cache_enabled = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.710891 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] image_volume_cache_max_count = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.711170 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Starting volume driver RBDDriver (1.2.0) Jun 04 20:43:13.711245 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] image_volume_cache_max_size_gb = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.711245 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] init_host_max_objects_retrieval = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.711245 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] instance_format = [instance: %(uuid)s] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.711837 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.712316 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] iscsi_iotype = fileio {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.712695 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] iscsi_secondary_ip_addresses = [] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.713060 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] iscsi_target_flags = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.713239 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:43:13.713421 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] iscsi_write_cache = on {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.713775 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] iser_helper = tgtadm {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.714397 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] iser_ip_address = 10.222.0.18 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.714947 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] iser_port = 3260 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.715375 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728194 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] log_config_append = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728194 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728194 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] log_dir = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728194 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] log_file = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728194 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] log_options = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728194 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] log_rotate_interval = 1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728194 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] log_rotate_interval_type = days {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728706 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] log_rotation_type = none {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728706 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728706 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728706 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.728706 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729132 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729132 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] max_age = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729132 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] max_logfile_count = 30 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729132 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] max_logfile_size_mb = 200 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729132 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] max_over_subscription_ratio = 20.0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729132 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] message_reap_interval = 86400 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729527 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] message_ttl = 2592000 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729527 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] migration_create_volume_timeout_secs = 300 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729527 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] monkey_patch = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729527 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] monkey_patch_modules = [] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729527 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] my_ip = 10.222.0.18 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729527 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] no_snapshot_gb_quota = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729527 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] num_iser_scan_tries = 3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729973 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] num_shell_tries = 3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729973 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] num_volume_device_scan_tries = 3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729973 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] nvmet_ns_id = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729973 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] nvmet_port_id = 1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729973 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] osapi_max_limit = 1000 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729973 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] osapi_volume_ext_list = [] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.729973 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.730431 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] osapi_volume_listen = 0.0.0.0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.730431 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] osapi_volume_listen_port = 8776 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.730431 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] osapi_volume_use_ssl = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.730431 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] osapi_volume_workers = 2 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.730431 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] per_volume_size_limit = -1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.730431 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] periodic_fuzzy_delay = 60 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.730431 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] periodic_interval = 60 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.730855 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] project_id_regex = [0-9a-f\-]+ {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.733036 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] public_endpoint = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.733036 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] publish_errors = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.733036 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] quota_backup_gigabytes = 1000 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.733036 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] quota_backups = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.733036 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] quota_consistencygroups = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.734722 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.734722 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] quota_gigabytes = 1000 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.734722 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] quota_groups = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.734722 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] quota_snapshots = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.734722 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] quota_volumes = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.735450 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] rate_limit_burst = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.735450 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] rate_limit_except_level = CRITICAL {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.735829 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] rate_limit_interval = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.736131 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] reinit_driver_count = 3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.736598 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] replication_device = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.736955 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] report_discard_supported = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.737294 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] report_interval = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.737838 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] reservation_clean_interval = 86400 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.738149 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] reservation_expire = 86400 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.738623 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] reserved_percentage = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.738868 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.739292 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.739627 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] rpc_response_timeout = 120 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.739993 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] run_external_periodic_tasks = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.740322 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.740690 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] scst_target_driver = iscsi {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.741028 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] scst_target_iqn_name = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.741312 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] service_down_time = 60 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.741801 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] snapshot_name_template = snapshot-%s {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.742146 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] snapshot_same_host = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.742617 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] split_loggers = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.743135 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] state_path = /opt/stack/data/cinder {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.743956 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] storage_availability_zone = nova {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.744158 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] storage_protocol = iSCSI {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.744550 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] syslog_log_facility = LOG_USER {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.744912 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] target_helper = lioadm {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.745500 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] target_ip_address = 10.222.0.18 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.745869 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] target_port = 3260 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.746235 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.746652 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] target_protocol = iscsi {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.746995 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] trace_flags = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.747367 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] transfer_api_class = cinder.transfer.api.API {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.747923 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] transport_url = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.748857 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] until_refresh = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.748857 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] use_chap_auth = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.749046 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] use_default_quota_class = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.749275 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] use_eventlog = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.749679 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] use_journal = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.750075 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] use_json = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.750422 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] use_multipath_for_image_xfer = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.750776 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] use_stderr = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.751137 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] use_syslog = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.751547 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] verify_glance_signatures = enabled {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.752046 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_api_class = cinder.volume.api.API {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.752409 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_backend_name = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.752800 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_clear = zero {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.753145 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_clear_ionice = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.753486 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_clear_size = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.753840 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.754176 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_copy_bps_limit = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.754541 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_dd_blocksize = 1M {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.754907 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.755501 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_name_template = volume-%s {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.755862 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_service_inithost_offload = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.756388 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volume_usage_audit_period = month {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.756863 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.757258 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] watch_log_file = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.757774 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] zoning_mode = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:43:13.758280 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.759352 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.759584 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_concurrency.disable_process_locking = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.759950 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.760375 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.760486 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:43:13.760720 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.761061 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_metrics.metrics_process_name = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.761420 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.761792 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.762252 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.admin_password = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.762612 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.admin_tenant_name = admin {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.763042 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.admin_token = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.763384 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.admin_user = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.771580 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.auth_admin_prefix = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.771580 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.771580 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.auth_port = 35357 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.771580 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.auth_protocol = https {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.771580 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.auth_section = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.771580 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.auth_type = password {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.771580 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.auth_uri = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772249 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.auth_version = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772249 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.cache = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772249 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772249 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.certfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772249 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.delay_auth_decision = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772249 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772668 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.http_connect_timeout = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772668 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772668 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.identity_uri = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772668 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.include_service_catalog = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772668 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.insecure = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.772668 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.interface = public {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.773059 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.keyfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.773059 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.773059 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.773059 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.773059 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.773059 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.773441 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.memcache_secret_key = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.773441 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.memcache_security_strategy = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.773441 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.773749 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.774219 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.region_name = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.774697 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.775025 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.service_token_roles_required = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.775369 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.service_type = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.776252 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.token_cache_time = 300 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.776616 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] keystone_authtoken.www_authenticate_uri = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.777084 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.backend = dogpile.cache.null {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.777458 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.backend_argument = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.777809 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.config_prefix = cache.oslo {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.778408 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.dead_timeout = 60.0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.778729 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.debug_cache_backend = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.779067 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.enable_retry_client = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.779436 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.enable_socket_keepalive = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.779794 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.enabled = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.780159 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.expiration_time = 600 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.780497 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.hashclient_retry_attempts = 2 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.780842 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.hashclient_retry_delay = 1.0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.781181 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.memcache_dead_retry = 300 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.781563 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.782475 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.782475 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.memcache_pool_maxsize = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.782659 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.memcache_pool_unused_timeout = 60 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.782964 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.memcache_servers = ['localhost:11211'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.783329 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.memcache_socket_timeout = 1.0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.783734 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.proxies = [] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.784074 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.retry_attempts = 2 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.784425 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.retry_delay = 0.0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.784766 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.socket_keepalive_count = 1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.785115 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.socket_keepalive_idle = 1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.785485 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.socket_keepalive_interval = 1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.786214 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.tls_allowed_ciphers = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.786587 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.tls_cafile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.786973 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.tls_certfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.787333 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.tls_enabled = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.787738 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cache.tls_keyfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.788228 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] coordination.backend_url = etcd3+http://10.222.0.18:2379 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.788685 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.backend = sqlalchemy {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.788992 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.connection = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.789355 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.connection_debug = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.789761 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.connection_parameters = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.790129 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.connection_recycle_time = 3600 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.790479 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.connection_trace = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.790839 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.db_inc_retry_interval = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.791198 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.db_max_retries = 20 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.791567 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.db_max_retry_interval = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.791915 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.db_retry_interval = 1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.792266 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.max_overflow = 50 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.792610 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.max_pool_size = 5 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.792979 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.max_retries = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.793322 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.mysql_enable_ndb = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.793687 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.mysql_sql_mode = TRADITIONAL {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.794028 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.pool_timeout = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.794415 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.retry_interval = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.794753 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.slave_connection = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.795095 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.sqlite_synchronous = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.795441 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] database.use_db_reconnect = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.796062 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_policy.enforce_new_defaults = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.796495 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_policy.enforce_scope = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.796860 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_policy.policy_default_rule = default {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.797227 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.797603 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_policy.policy_file = policy.yaml {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.798000 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.798371 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.798815 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.799183 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.799833 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.800027 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] profiler.connection_string = messaging:// {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.800285 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] profiler.enabled = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.800651 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] profiler.es_doc_type = notification {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.801007 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] profiler.es_scroll_size = 10000 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.801353 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] profiler.es_scroll_time = 2m {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.801683 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] profiler.filter_error_trace = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.802053 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] profiler.hmac_keys = SECRET_KEY {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.802420 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] profiler.sentinel_service_name = mymaster {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.802793 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] profiler.socket_timeout = 0.1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.803136 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] profiler.trace_sqlalchemy = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.803570 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] privsep_osbrick.capabilities = [21] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.804191 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] privsep_osbrick.group = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.804560 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] privsep_osbrick.helper_command = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.804914 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.805381 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] privsep_osbrick.thread_pool_size = 4 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.805788 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] privsep_osbrick.user = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.806377 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.806738 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cinder_sys_admin.group = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.807080 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cinder_sys_admin.helper_command = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.807430 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.807899 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.808243 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] cinder_sys_admin.user = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.808623 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] service_user.auth_section = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.808967 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] service_user.auth_type = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.809331 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] service_user.cafile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.809757 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] service_user.certfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.810078 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] service_user.collect_timing = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.810358 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] service_user.insecure = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.810700 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] service_user.keyfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.811025 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] service_user.send_service_user_token = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.811362 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] service_user.split_loggers = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.811756 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] service_user.timeout = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.812176 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.backend_availability_zone = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.812521 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.812867 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.813229 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.chap_password = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.813625 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.chap_username = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.813976 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.814326 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.814683 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.815026 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.driver_client_cert = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.815457 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.driver_client_cert_key = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.815725 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.driver_data_namespace = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.816056 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.driver_ssl_cert_path = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.816671 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.816912 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.driver_use_ssl = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.817316 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.enable_deferred_deletion = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.817709 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.enable_unsupported_driver = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.817920 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.818459 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.extra_capabilities = {} {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.818593 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.filter_function = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.818976 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.goodness_function = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.819295 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.819658 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.819996 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.820363 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.image_volume_cache_enabled = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.821112 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.821112 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.821410 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.iscsi_iotype = fileio {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.821791 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.822171 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.iscsi_target_flags = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.822598 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.iscsi_write_cache = on {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.822965 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.iser_helper = tgtadm {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.825231 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.iser_ip_address = 10.222.0.18 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.825732 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.iser_port = 3260 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.826509 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.826952 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.827318 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.827712 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.num_shell_tries = 3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.828279 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.828488 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.nvmet_ns_id = 10 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.828849 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.nvmet_port_id = 1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.829247 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rados_connect_timeout = -1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.829916 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rados_connection_interval = 5 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.830336 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rados_connection_retries = 3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.830711 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rbd_ceph_conf = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.831074 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rbd_cluster_name = ceph {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.831425 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.831822 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.832179 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.832651 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rbd_pool = rbd {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.833001 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rbd_secret_uuid = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.833383 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.833708 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.rbd_user = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.834054 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.replication_connect_timeout = 5 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.834400 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.replication_device = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.834756 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.report_discard_supported = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.835110 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.835455 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.reserved_percentage = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.836010 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.scst_target_driver = iscsi {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.836265 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.scst_target_iqn_name = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.839552 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.storage_protocol = iSCSI {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.839552 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.839552 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.target_helper = tgtadm {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.840759 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:43:13.840847 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.target_ip_address = 10.222.0.18 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.840847 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.target_port = 3260 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.840847 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.840847 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.target_protocol = iscsi {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.840847 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.trace_flags = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.840847 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.unique_fqdn_network = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.842043 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.use_chap_auth = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.842043 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.842043 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.volume_backend_name = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.842043 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.volume_clear = zero {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.842043 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.volume_clear_ionice = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.842043 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.volume_clear_size = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.842424 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.842424 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.843357 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.843357 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.843561 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.844090 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_reports.file_event_handler = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.844451 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_reports.file_event_handler_interval = 1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.844804 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_reports.log_dir = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.845193 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.backend_availability_zone = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.845534 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.backend_host = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.845873 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.backend_native_threads_pool_size = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.846210 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.backup_use_temp_snapshot = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.846555 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.chap_password = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.847037 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.chap_username = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.847379 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.chiscsi_conf = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.847760 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.deferred_deletion_delay = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.848118 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.deferred_deletion_purge_interval = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.848510 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.driver_client_cert = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.848790 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.driver_client_cert_key = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.849127 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.driver_data_namespace = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.849463 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.driver_ssl_cert_path = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.849900 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.driver_ssl_cert_verify = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.850237 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.driver_use_ssl = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.850570 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.enable_deferred_deletion = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.850914 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.enable_unsupported_driver = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.851248 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.851613 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.extra_capabilities = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.851984 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.filter_function = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.852332 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.goodness_function = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.852674 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.iet_conf = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.853006 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.image_upload_use_cinder_backend = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.853340 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.image_upload_use_internal_tenant = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.853708 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.image_volume_cache_enabled = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.854045 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.image_volume_cache_max_count = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.854405 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.image_volume_cache_max_size_gb = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.854741 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.iscsi_iotype = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.855088 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.855665 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.iscsi_target_flags = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.856005 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.iscsi_write_cache = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.856342 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.iser_helper = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.856704 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.iser_ip_address = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.857282 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.iser_port = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.858026 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.iser_target_prefix = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.858026 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.max_over_subscription_ratio = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.858330 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.num_iser_scan_tries = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.858705 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.num_shell_tries = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.859118 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.num_volume_device_scan_tries = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.859364 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.nvmet_ns_id = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.859921 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.nvmet_port_id = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.860108 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rados_connect_timeout = -1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.860454 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rados_connection_interval = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.860834 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rados_connection_retries = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.861219 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.861478 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rbd_cluster_name = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.861980 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.862181 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.862551 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rbd_max_clone_depth = 5 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.862902 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rbd_pool = volumes {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.863254 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rbd_secret_uuid = d8ae048c-c0fd-42d9-9cc3-0736d027658d {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.863844 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rbd_store_chunk_size = 4 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.864050 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.rbd_user = cinder {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.864390 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.replication_connect_timeout = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.864727 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.replication_device = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.865070 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.report_discard_supported = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.865404 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.report_dynamic_total_capacity = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.865737 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.reserved_percentage = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.866091 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.scst_target_driver = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.866424 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.scst_target_iqn_name = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.866761 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.storage_protocol = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.867566 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.suppress_requests_ssl_warnings = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.868062 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.target_helper = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.868405 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.target_ip_address = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.868742 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.target_port = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.869075 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.target_prefix = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.869407 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.target_protocol = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.869745 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.trace_flags = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.870209 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.unique_fqdn_network = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.870439 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.use_chap_auth = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.870745 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.use_multipath_for_image_xfer = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.871109 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.volume_backend_name = ceph {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.871502 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.volume_clear = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.871797 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.volume_clear_ionice = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.872350 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.volume_clear_size = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.872462 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.872798 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.volume_copy_bps_limit = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.873131 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.volume_dd_blocksize = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.873487 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.873837 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ceph.volumes_dir = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.874294 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.874601 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.874961 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.875305 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.875771 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.876117 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.878253 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.878610 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.878992 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.879339 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.879949 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.880489 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.881102 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.881691 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.882247 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.882820 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.883259 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.883701 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.884063 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.884565 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.884946 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.885317 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.885715 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.ssl = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.886093 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.886453 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.886800 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.887171 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.887787 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_rabbit.ssl_version = {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.888335 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_notifications.driver = [] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.888898 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_notifications.retry = -1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.889630 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.890153 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] oslo_messaging_notifications.transport_url = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.890499 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.890796 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] key_manager.fixed_key = **** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.891224 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.891622 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.barbican_api_version = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.891982 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.barbican_endpoint = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.892279 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.driver [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Driver hasn't implemented _init_vendor_properties() Jun 04 20:43:13.892391 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.barbican_endpoint_type = public {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.892702 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.driver [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:0cd88407-50fe-40f1-b36a-024c7a53e9bf:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=130490) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}} Jun 04 20:43:13.892827 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.barbican_region_name = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.893031 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.cafile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.893379 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.certfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.893737 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.collect_timing = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.894076 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.insecure = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.894417 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.keyfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.894765 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.number_of_retries = 60 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.895117 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.retry_delay = 1 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.895459 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.send_service_user_token = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.895841 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.split_loggers = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.896175 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.timeout = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.896522 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.verify_ssl = True {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.896858 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican.verify_ssl_path = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.897226 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican_service_user.auth_section = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.897707 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican_service_user.auth_type = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.898046 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican_service_user.cafile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.898389 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican_service_user.certfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.898722 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican_service_user.collect_timing = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.899178 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican_service_user.insecure = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.899724 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican_service_user.keyfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.900240 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican_service_user.split_loggers = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.900581 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] barbican_service_user.timeout = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.901295 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.approle_role_id = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.901651 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.approle_secret_id = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.902008 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.cafile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.902342 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.certfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.902680 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.collect_timing = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.903017 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.insecure = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.903349 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.keyfile = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.903752 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.kv_mountpoint = secret {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.904114 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.kv_version = 2 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.904448 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.namespace = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.904782 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.root_token_id = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.905140 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.split_loggers = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.905408 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_db.sqlalchemy.engines [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130490) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:43:13.905541 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.ssl_ca_crt_file = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.905804 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.timeout = None {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.906134 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.use_ssl = False {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.906642 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:43:13.907078 ncdv-master-1 cinder-volume[130277]: DEBUG oslo_service.service [None req-4cf32016-01bf-4f75-91b1-d43f6dae59de None None] ******************************************************************************** {{(pid=130277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 20:43:13.908947 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writer thread running {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:43:13.942508 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.db.sqlalchemy.api [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Building query based on filter {{(pid=130490) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3850}} Jun 04 20:43:13.962228 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.image_utils [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=130490) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:991}} Jun 04 20:43:13.969671 ncdv-master-1 cinder-volume[130490]: INFO cinder.keymgr.migration [None req-37d20a0c-4599-41a7-b47c-a2506efee3a6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 04 20:43:13.983390 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:43:14.011421 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:43:14.063337 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:43:14.099168 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Driver initialization completed successfully. Jun 04 20:43:14.099869 ncdv-master-1 cinder-volume[130490]: INFO cinder.manager [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Initiating service 3 cleanup Jun 04 20:43:14.110339 ncdv-master-1 cinder-volume[130490]: INFO cinder.manager [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Service 3 cleanup completed. Jun 04 20:43:14.110687 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.service [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Creating RPC server for service cinder-volume {{(pid=130490) start /opt/stack/cinder/cinder/service.py:231}} Jun 04 20:43:14.119237 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.service [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=130490) start /opt/stack/cinder/cinder/service.py:237}} Jun 04 20:43:14.205504 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Jun 04 20:43:14.206814 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:43:14.263594 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:43:14.324449 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-37a08ee3-7544-4181-babe-60155507e0b3 None None] Driver post RPC initialization completed successfully. Jun 04 20:43:23.652183 ncdv-master-1 cinder-volume[130277]: DEBUG dbcounter [-] [130277] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=130277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:24.317541 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=22,cinder:INSERT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:24.319865 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:34.347609 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:54.335202 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:14.338360 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:34.336816 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:34.340965 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:45.328158 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:44:45.328963 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:44:45.353206 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:44:45.382737 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:45:04.345360 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:45:14.336341 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:45:44.336666 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:45:45.327977 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:45:45.328548 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:45:45.352428 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:45:45.384515 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:45:54.334405 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:46:24.333563 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:46:24.335805 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:46:45.329534 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:46:45.330247 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:46:45.353728 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:46:45.378146 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:46:54.333031 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:04.336864 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:24.334396 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:34.339271 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:45.333657 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:47:45.334398 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:47:45.366987 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:47:45.391973 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:47:54.343266 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:48:04.351737 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:48:34.336747 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:48:44.338210 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:48:45.337470 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:48:45.338117 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:48:45.364030 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:48:45.399549 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:49:14.338632 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:49:24.335535 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:49:44.333418 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:49:45.335550 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:49:45.336668 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:49:45.362182 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:49:45.390604 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:49:54.353405 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:14.347665 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:24.361051 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:44.359231 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:45.337253 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:50:45.337923 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:50:45.362582 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:50:45.389926 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:51:04.352466 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:51:24.353404 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:51:24.355922 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:51:45.337005 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:51:45.338052 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:51:45.406467 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:51:45.440026 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:52:04.350111 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:04.354023 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:24.353209 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:34.354709 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:45.337646 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:52:45.338623 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:52:45.434762 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:52:45.502362 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:52:54.382654 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:14.381842 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:34.407382 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:45.335046 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:53:45.335885 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:53:45.452657 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:53:45.548561 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:53:54.382979 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:14.380907 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:34.385213 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:44.385592 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:45.337692 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:54:45.338775 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:54:45.413115 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:54:45.497952 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:55:14.397434 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:24.391867 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:45.336445 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:55:45.337214 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:55:45.408216 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:55:45.468966 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:55:54.400889 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:04.400215 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:15.430241 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:56:15.484351 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Flow 'volume_create_manager' (d30cc1e2-3a41-44da-b60e-68a2a63cce28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:56:15.491624 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b09088-397b-4e2c-a751-769682d5f770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:15.545212 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b09088-397b-4e2c-a751-769682d5f770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1420834690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=94b159b1-5ff2-48ce-8547-8af2ac101852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aeb9ab07bf8476082d5add829aec29f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T20:56:15Z,use_quota=True,user_id='ac8ef83fa94e4c9db70a0115cc867dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:15.550045 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3adb56-594a-409b-8710-7329cf8e1907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:15.554011 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3adb56-594a-409b-8710-7329cf8e1907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:15.558589 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cad45c-08be-41d1-8108-4aaf6087f4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:15.562793 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cad45c-08be-41d1-8108-4aaf6087f4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94b159b1-5ff2-48ce-8547-8af2ac101852', 'volume_name': 'volume-94b159b1-5ff2-48ce-8547-8af2ac101852', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:15.570907 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c2fc87-ec07-463f-9326-641f79881eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:15.575148 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c2fc87-ec07-463f-9326-641f79881eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:15.579640 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06b9e67-144c-4b72-add6-82f21882bdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:15.580694 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Volume 94b159b1-5ff2-48ce-8547-8af2ac101852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94b159b1-5ff2-48ce-8547-8af2ac101852', 'volume_size': 1} Jun 04 20:56:15.581106 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] creating volume 'volume-94b159b1-5ff2-48ce-8547-8af2ac101852' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 20:56:15.581914 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:56:15.739972 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:56:15.740210 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:56:15.747250 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06b9e67-144c-4b72-add6-82f21882bdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b159b1-5ff2-48ce-8547-8af2ac101852', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:15.757692 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d783a2-6d2f-4fa3-b5f2-392103d7a91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:15.775369 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Volume volume-94b159b1-5ff2-48ce-8547-8af2ac101852 (94b159b1-5ff2-48ce-8547-8af2ac101852): created successfully Jun 04 20:56:15.784759 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d783a2-6d2f-4fa3-b5f2-392103d7a91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:15.793747 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Flow 'volume_create_manager' (d30cc1e2-3a41-44da-b60e-68a2a63cce28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:56:15.825384 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f75c49e4-2200-466b-9038-758786ed99da tempest-LiveMigrationTest-647686994 None] Created volume successfully. Jun 04 20:56:17.781057 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-562a4f39-e025-495a-84f2-e730fdeb8568 req-32fb6207-c6bf-4e89-a27e-f088b3cffad1 tempest-LiveMigrationTest-647686994 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:56:18.972609 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-562a4f39-e025-495a-84f2-e730fdeb8568 req-32fb6207-c6bf-4e89-a27e-f088b3cffad1 tempest-LiveMigrationTest-647686994 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.187s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:56:18.975293 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-562a4f39-e025-495a-84f2-e730fdeb8568 req-32fb6207-c6bf-4e89-a27e-f088b3cffad1 tempest-LiveMigrationTest-647686994 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-94b159b1-5ff2-48ce-8547-8af2ac101852', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '94b159b1-5ff2-48ce-8547-8af2ac101852', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 20:56:19.033420 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-562a4f39-e025-495a-84f2-e730fdeb8568 req-32fb6207-c6bf-4e89-a27e-f088b3cffad1 tempest-LiveMigrationTest-647686994 None] Connection info returned from driver {'name': 'volumes/volume-94b159b1-5ff2-48ce-8547-8af2ac101852', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '94b159b1-5ff2-48ce-8547-8af2ac101852', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aa7b3eea-590a-4e4a-a394-24f25cc6267d'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 20:56:19.148148 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-562a4f39-e025-495a-84f2-e730fdeb8568 req-32fb6207-c6bf-4e89-a27e-f088b3cffad1 tempest-LiveMigrationTest-647686994 None] attachment_update completed successfully. Jun 04 20:56:27.940029 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e req-30acb597-5cda-444e-9108-8c528a60bbb0 tempest-LiveMigrationTest-1887059151 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:56:28.911205 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e req-30acb597-5cda-444e-9108-8c528a60bbb0 tempest-LiveMigrationTest-1887059151 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.971s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:56:28.912011 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e req-30acb597-5cda-444e-9108-8c528a60bbb0 tempest-LiveMigrationTest-1887059151 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-94b159b1-5ff2-48ce-8547-8af2ac101852', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '94b159b1-5ff2-48ce-8547-8af2ac101852', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 20:56:28.936725 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=20,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:28.942453 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e req-30acb597-5cda-444e-9108-8c528a60bbb0 tempest-LiveMigrationTest-1887059151 None] Connection info returned from driver {'name': 'volumes/volume-94b159b1-5ff2-48ce-8547-8af2ac101852', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '94b159b1-5ff2-48ce-8547-8af2ac101852', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'be4f6074-c0fd-4bf0-a0bf-c0b4faf0242e'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 20:56:29.033411 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e req-30acb597-5cda-444e-9108-8c528a60bbb0 tempest-LiveMigrationTest-1887059151 None] attachment_update completed successfully. Jun 04 20:56:34.413560 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=35,cinder:UPDATE=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:38.694625 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:56:38.721582 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Flow 'volume_create_manager' (67144045-100e-409a-9380-5c78e8d2e55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:56:38.728986 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb29521b-073d-46da-8f0f-7496cdc86fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:38.749778 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb29521b-073d-46da-8f0f-7496cdc86fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-536456835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e06b5b5e-3556-4d37-8d19-14ad4e46dd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6707eb81235a4370a48c97279b7cfd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T20:56:39Z,use_quota=True,user_id='39e45a1e351c47bc8d9c9f317a7d915e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:38.755923 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d83d039-809c-403c-add5-64a09350ebcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:38.760323 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d83d039-809c-403c-add5-64a09350ebcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:38.766405 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ccc3735-091e-4106-940f-659571d7affb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:38.770832 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ccc3735-091e-4106-940f-659571d7affb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e06b5b5e-3556-4d37-8d19-14ad4e46dd6a', 'volume_name': 'volume-e06b5b5e-3556-4d37-8d19-14ad4e46dd6a', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:38.776125 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afad9478-0b3d-4e86-bf5c-c83bfd742b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:38.780726 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afad9478-0b3d-4e86-bf5c-c83bfd742b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:38.785469 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9a2203-14d0-43ef-a374-02eb3f79d51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:38.786547 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Volume e06b5b5e-3556-4d37-8d19-14ad4e46dd6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e06b5b5e-3556-4d37-8d19-14ad4e46dd6a', 'volume_size': 1} Jun 04 20:56:38.786955 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] creating volume 'volume-e06b5b5e-3556-4d37-8d19-14ad4e46dd6a' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 20:56:38.787735 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:56:38.890663 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:56:38.891180 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:56:38.894740 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9a2203-14d0-43ef-a374-02eb3f79d51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e06b5b5e-3556-4d37-8d19-14ad4e46dd6a', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:38.899373 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba09a0f-32be-4f57-be3f-0203a74d40a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:38.911723 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Volume volume-e06b5b5e-3556-4d37-8d19-14ad4e46dd6a (e06b5b5e-3556-4d37-8d19-14ad4e46dd6a): created successfully Jun 04 20:56:38.915890 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba09a0f-32be-4f57-be3f-0203a74d40a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:38.921230 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Flow 'volume_create_manager' (67144045-100e-409a-9380-5c78e8d2e55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:56:38.931817 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-35ceae66-2687-464f-b47c-485d39e5d325 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Created volume successfully. Jun 04 20:56:40.494469 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-8ad34577-6680-4050-a56d-e54b7f1d4c64 req-6b381f5e-1416-4e69-9236-90a9489621d4 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:56:41.165660 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-8ad34577-6680-4050-a56d-e54b7f1d4c64 req-6b381f5e-1416-4e69-9236-90a9489621d4 tempest-AttachSCSIVolumeTestJSON-2115443469 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.671s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:56:41.166632 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-8ad34577-6680-4050-a56d-e54b7f1d4c64 req-6b381f5e-1416-4e69-9236-90a9489621d4 tempest-AttachSCSIVolumeTestJSON-2115443469 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e06b5b5e-3556-4d37-8d19-14ad4e46dd6a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'e06b5b5e-3556-4d37-8d19-14ad4e46dd6a', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 20:56:41.197444 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8ad34577-6680-4050-a56d-e54b7f1d4c64 req-6b381f5e-1416-4e69-9236-90a9489621d4 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Connection info returned from driver {'name': 'volumes/volume-e06b5b5e-3556-4d37-8d19-14ad4e46dd6a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e06b5b5e-3556-4d37-8d19-14ad4e46dd6a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6c7c89a4-c784-4e8c-b464-fb6911b7046a'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 20:56:41.260295 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-8ad34577-6680-4050-a56d-e54b7f1d4c64 req-6b381f5e-1416-4e69-9236-90a9489621d4 tempest-AttachSCSIVolumeTestJSON-2115443469 None] attachment_update completed successfully. Jun 04 20:56:45.337624 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:56:45.338542 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:56:45.377854 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:56:45.432147 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:56:45.897845 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e req-4549131a-c394-4984-bda7-528140c7f32f tempest-LiveMigrationTest-1887059151 None] Terminate volume connection completed successfully. Jun 04 20:56:45.898251 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e req-4549131a-c394-4984-bda7-528140c7f32f tempest-LiveMigrationTest-1887059151 None] Deleting attachment aa7b3eea-590a-4e4a-a394-24f25cc6267d. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 20:56:45.961599 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-398227a9-f69d-4d2e-9066-5ef202fef928 req-36b007b2-e048-40d7-a853-d698ccb5bd7d tempest-AttachSCSIVolumeTestJSON-2115443469 None] Terminate volume connection completed successfully. Jun 04 20:56:45.961999 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-398227a9-f69d-4d2e-9066-5ef202fef928 req-36b007b2-e048-40d7-a853-d698ccb5bd7d tempest-AttachSCSIVolumeTestJSON-2115443469 None] Deleting attachment 6c7c89a4-c784-4e8c-b464-fb6911b7046a. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 20:56:54.834302 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-14c501ad-c086-4c47-b7cf-559a5f93ceed req-eb579b34-8dd5-4026-8b83-b23d6f093a2b tempest-LiveMigrationTest-647686994 None] Terminate volume connection completed successfully. Jun 04 20:56:54.834901 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-14c501ad-c086-4c47-b7cf-559a5f93ceed req-eb579b34-8dd5-4026-8b83-b23d6f093a2b tempest-LiveMigrationTest-647686994 None] Deleting attachment be4f6074-c0fd-4bf0-a0bf-c0b4faf0242e. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 20:56:56.392200 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:56:56.416694 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Flow 'volume_create_manager' (e31557a5-dbad-48e1-afbd-bb72b3de5661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:56:56.423361 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3d3668-1cad-4551-a8fd-b6aff8c49311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:56.441530 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3d3668-1cad-4551-a8fd-b6aff8c49311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2024898481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b6358b5-f2c7-4f84-93be-b0746120aafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aeb9ab07bf8476082d5add829aec29f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T20:56:56Z,use_quota=True,user_id='ac8ef83fa94e4c9db70a0115cc867dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:56.447452 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5e03e2-42db-432c-b4a7-5e3c4c237bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:56.452830 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5e03e2-42db-432c-b4a7-5e3c4c237bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:56.458725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb71c72-3b05-4200-9ddd-e81ef1f7211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:56.595359 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb71c72-3b05-4200-9ddd-e81ef1f7211a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b6358b5-f2c7-4f84-93be-b0746120aafa', 'volume_name': 'volume-7b6358b5-f2c7-4f84-93be-b0746120aafa', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:56.600247 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293d1af1-4754-4ab0-8507-1d95b821528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:56.604841 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293d1af1-4754-4ab0-8507-1d95b821528d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:56:56.624997 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12076b1-5c2d-49f1-9e95-3809e83cac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:56:56.626382 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Volume 7b6358b5-f2c7-4f84-93be-b0746120aafa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b6358b5-f2c7-4f84-93be-b0746120aafa', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 20:56:56.627255 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Cloning 7b6358b5-f2c7-4f84-93be-b0746120aafa from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 20:56:56.635942 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 20:56:56.646545 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Preparing cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:882}} Jun 04 20:56:56.647705 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 20:57:02.385873 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=40,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:02.395165 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:57:02.428140 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Flow 'volume_create_manager' (47e399cd-a050-454b-8166-e4526685ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:57:02.441647 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8e796a-2ad1-4068-9644-43839998e43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:02.485825 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8e796a-2ad1-4068-9644-43839998e43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-990987564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=726addd0-8ade-4bdb-9f22-f610d44a32e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b90f117684cff9d0ffccf630d8307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T20:57:02Z,use_quota=True,user_id='71d29871def3409f89efcda0e82a4ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:02.492105 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56416a0d-af66-45d3-882c-b1de51f3b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:02.497188 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56416a0d-af66-45d3-882c-b1de51f3b28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:02.505406 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a9e15d-996c-45e9-bcfc-69455637af07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:02.512272 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a9e15d-996c-45e9-bcfc-69455637af07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726addd0-8ade-4bdb-9f22-f610d44a32e9', 'volume_name': 'volume-726addd0-8ade-4bdb-9f22-f610d44a32e9', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:02.541663 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9674db36-9d26-4113-b62f-ca68d19ad377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:02.546370 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9674db36-9d26-4113-b62f-ca68d19ad377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:02.551097 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf0e7b4-f417-4e7e-9bd5-abc54afdf5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:02.553177 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Volume 726addd0-8ade-4bdb-9f22-f610d44a32e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726addd0-8ade-4bdb-9f22-f610d44a32e9', 'volume_size': 1} Jun 04 20:57:02.554186 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] creating volume 'volume-726addd0-8ade-4bdb-9f22-f610d44a32e9' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 20:57:02.554914 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:02.641059 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Lock "b'cinder-e06b5b5e-3556-4d37-8d19-14ad4e46dd6a-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 20:57:02.678671 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:57:02.679123 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:57:02.683268 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf0e7b4-f417-4e7e-9bd5-abc54afdf5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726addd0-8ade-4bdb-9f22-f610d44a32e9', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:02.688099 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab1cc72-0337-42ef-9ed0-f62bd537bc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:02.710102 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Volume volume-726addd0-8ade-4bdb-9f22-f610d44a32e9 (726addd0-8ade-4bdb-9f22-f610d44a32e9): created successfully Jun 04 20:57:02.714402 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab1cc72-0337-42ef-9ed0-f62bd537bc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:02.719971 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Flow 'volume_create_manager' (47e399cd-a050-454b-8166-e4526685ea91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:57:02.743935 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:02.834678 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 20:57:02.840412 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Volume volume-e06b5b5e-3556-4d37-8d19-14ad4e46dd6a is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 20:57:02.872434 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] deleting rbd volume volume-e06b5b5e-3556-4d37-8d19-14ad4e46dd6a {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 20:57:02.872434 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3fca5993-b61d-4f07-a05c-6bc6985c42ea tempest-VolumesAdminNegativeTest-685027402 None] Created volume successfully. Jun 04 20:57:03.614079 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Jun 04 20:57:03.614954 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Jun 04 20:57:03.645000 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Created reservations ['1b4ab550-84c1-4725-87cb-de1ab8153407', '0754246e-5575-4264-8488-a63d8b14160c', 'b0dded0a-2dc2-43b8-9401-80fe4242ebb7', '43f8a258-0fa3-4062-a43d-fdd77878fcbe'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 20:57:03.748100 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:03.815042 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:03.896135 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:57:03.904540 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Deleted volume successfully. Jun 04 20:57:03.936757 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-a52af4ad-662f-4a9f-9fe4-6aee368abdc0 tempest-AttachSCSIVolumeTestJSON-2115443469 None] Lock "b'cinder-e06b5b5e-3556-4d37-8d19-14ad4e46dd6a-delete_volume'" released by "delete_volume" :: held 1.296s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 20:57:04.472864 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=16,cinder:SELECT=46,cinder:DELETE=2,cinder:INSERT=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:04.872085 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-4fe6a645-f871-497e-bc1f-36d7d07361ed req-618da49e-dddf-4bb6-ac72-2de43a1f977f tempest-VolumesAdminNegativeTest-685027402 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:57:06.178583 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-4fe6a645-f871-497e-bc1f-36d7d07361ed req-618da49e-dddf-4bb6-ac72-2de43a1f977f tempest-VolumesAdminNegativeTest-685027402 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.305s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:57:06.184637 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-4fe6a645-f871-497e-bc1f-36d7d07361ed req-618da49e-dddf-4bb6-ac72-2de43a1f977f tempest-VolumesAdminNegativeTest-685027402 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-726addd0-8ade-4bdb-9f22-f610d44a32e9', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '726addd0-8ade-4bdb-9f22-f610d44a32e9', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 20:57:06.293197 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-4fe6a645-f871-497e-bc1f-36d7d07361ed req-618da49e-dddf-4bb6-ac72-2de43a1f977f tempest-VolumesAdminNegativeTest-685027402 None] Connection info returned from driver {'name': 'volumes/volume-726addd0-8ade-4bdb-9f22-f610d44a32e9', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '726addd0-8ade-4bdb-9f22-f610d44a32e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '92516742-2834-4d52-b144-e0c6ac80afcd'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 20:57:06.526166 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-4fe6a645-f871-497e-bc1f-36d7d07361ed req-618da49e-dddf-4bb6-ac72-2de43a1f977f tempest-VolumesAdminNegativeTest-685027402 None] attachment_update completed successfully. Jun 04 20:57:11.513228 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-2a4bb679-a54c-411d-847b-f89813126c54 req-7ea0e6c1-5dc6-484d-807c-9c12bc2fc204 tempest-VolumesAdminNegativeTest-685027402 None] Terminate volume connection completed successfully. Jun 04 20:57:11.515658 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-2a4bb679-a54c-411d-847b-f89813126c54 req-7ea0e6c1-5dc6-484d-807c-9c12bc2fc204 tempest-VolumesAdminNegativeTest-685027402 None] Deleting attachment 92516742-2834-4d52-b144-e0c6ac80afcd. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 20:57:18.074321 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.image_utils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph, size 616.00 MB, duration 21.42 sec {{(pid=130490) fetch /opt/stack/cinder/cinder/image/image_utils.py:587}} Jun 04 20:57:18.074321 ncdv-master-1 cinder-volume[130490]: INFO cinder.image.image_utils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Image download 616.00 MB at 28.76 MB/s Jun 04 20:57:18.137957 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:57:18.317165 ncdv-master-1 sudo[142654]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph Jun 04 20:57:18.318019 ncdv-master-1 sudo[142654]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 04 20:57:19.911067 ncdv-master-1 sudo[142654]: pam_unix(sudo:session): session closed for user root Jun 04 20:57:19.914567 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph" returned: 0 in 1.777s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:57:19.920021 ncdv-master-1 cinder-volume[130490]: WARNING py.warnings [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jun 04 20:57:19.920021 ncdv-master-1 cinder-volume[130490]: debtcollector.deprecate( Jun 04 20:57:19.920021 ncdv-master-1 cinder-volume[130490]: Jun 04 20:57:19.920775 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.image_utils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Temporary image 926a4015-c327-4be7-9086-5cce1a8e0ebf is fetched for user ac8ef83fa94e4c9db70a0115cc867dfc. {{(pid=130490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1124}} Jun 04 20:57:19.995317 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:57:20.220806 ncdv-master-1 sudo[142678]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph Jun 04 20:57:20.221835 ncdv-master-1 sudo[142678]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 04 20:57:22.159174 ncdv-master-1 sudo[142678]: pam_unix(sudo:session): session closed for user root Jun 04 20:57:22.161578 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph" returned: 0 in 2.166s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:57:22.162592 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] creating volume 'volume-7b6358b5-f2c7-4f84-93be-b0746120aafa' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 20:57:22.164096 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:22.347705 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:57:22.348481 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:57:22.387379 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Attempting download of 926a4015-c327-4be7-9086-5cce1a8e0ebf ((None, None)) to volume 7b6358b5-f2c7-4f84-93be-b0746120aafa. {{(pid=130490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1181}} Jun 04 20:57:22.442195 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_926a4015-c327-4be7-9086-5cce1a8e0ebf_slp430gl {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:57:22.866179 ncdv-master-1 sudo[142757]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_926a4015-c327-4be7-9086-5cce1a8e0ebf_slp430gl Jun 04 20:57:22.867050 ncdv-master-1 sudo[142757]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 04 20:57:25.100662 ncdv-master-1 sudo[142757]: pam_unix(sudo:session): session closed for user root Jun 04 20:57:25.105589 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_926a4015-c327-4be7-9086-5cce1a8e0ebf_slp430gl" returned: 0 in 2.662s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:57:25.107156 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:57:25.347393 ncdv-master-1 sudo[142828]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph Jun 04 20:57:25.352131 ncdv-master-1 sudo[142828]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 04 20:57:27.560900 ncdv-master-1 sudo[142828]: pam_unix(sudo:session): session closed for user root Jun 04 20:57:27.563331 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph" returned: 0 in 2.456s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:57:27.564262 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.image_utils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] 926a4015-c327-4be7-9086-5cce1a8e0ebf was vhdx, converting to raw {{(pid=130490) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:825}} Jun 04 20:57:27.565446 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpnv3y_2v5 {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:57:27.594746 ncdv-master-1 sudo[142875]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpnv3y_2v5 Jun 04 20:57:27.595587 ncdv-master-1 sudo[142875]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 04 20:57:31.070586 ncdv-master-1 sudo[142875]: pam_unix(sudo:session): session closed for user root Jun 04 20:57:31.075828 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpnv3y_2v5" returned: 0 in 3.510s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:57:31.079933 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:57:31.346993 ncdv-master-1 sudo[142958]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph Jun 04 20:57:31.355598 ncdv-master-1 sudo[142958]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 04 20:57:33.088352 ncdv-master-1 sudo[142958]: pam_unix(sudo:session): session closed for user root Jun 04 20:57:33.092107 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph" returned: 0 in 2.011s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:57:33.093694 ncdv-master-1 cinder-volume[130490]: WARNING py.warnings [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jun 04 20:57:33.093694 ncdv-master-1 cinder-volume[130490]: debtcollector.deprecate( Jun 04 20:57:33.093694 ncdv-master-1 cinder-volume[130490]: Jun 04 20:57:33.094703 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.image_utils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_926a4015-c327-4be7-9086-5cce1a8e0ebf_8f975z6lncdv-master-1@ceph, size 700.00 MB, duration 3.51 sec, destination /opt/stack/data/cinder/conversion/tmpnv3y_2v5 {{(pid=130490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:419}} Jun 04 20:57:33.095228 ncdv-master-1 cinder-volume[130490]: INFO cinder.image.image_utils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Converted 700.00 MB image at 199.21 MB/s Jun 04 20:57:33.096995 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:33.198659 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 20:57:33.199111 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 20:57:33.215407 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] deleting rbd volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 20:57:33.699731 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpnv3y_2v5 volume-7b6358b5-f2c7-4f84-93be-b0746120aafa --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:57:34.443181 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=32,cinder:UPDATE=11 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:40.680581 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpnv3y_2v5 volume-7b6358b5-f2c7-4f84-93be-b0746120aafa --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 6.981s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:57:40.976725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:41.241553 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:57:41.242122 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:57:41.242625 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Downloaded image 926a4015-c327-4be7-9086-5cce1a8e0ebf ((None, None)) to volume 7b6358b5-f2c7-4f84-93be-b0746120aafa successfully. {{(pid=130490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1223}} Jun 04 20:57:41.469607 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.image_utils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Temporary image 926a4015-c327-4be7-9086-5cce1a8e0ebf for user ac8ef83fa94e4c9db70a0115cc867dfc is deleted. {{(pid=130490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1128}} Jun 04 20:57:41.487652 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=22,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:41.661076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Created reservations ['3ec12674-deff-4d63-bd1b-e16660be2e86', 'c7c5f4cc-b070-4217-b45d-460e775c465e', 'd666480a-fcfe-4181-81ef-e712958f4d80', '6917d1dc-9955-4663-822c-c376eb021fae'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 20:57:41.685706 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Creating image volume entry: {'service_uuid': None, 'host': 'ncdv-master-1@ceph#ceph', 'provider_geometry': None, 'ec2_id': None, 'volume_admin_metadata': [], 'multiattach': False, 'encryption_key_id': None, 'created_at': datetime.datetime(2022, 6, 4, 20, 56, 56, tzinfo=datetime.timezone.utc), 'display_description': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'provider_auth': None, 'group_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'provider_location': None, 'size': 1, 'deleted': False, 'volume_type_id': '6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3', 'deleted_at': None, 'replication_extended_status': None, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'scheduled_at': datetime.datetime(2022, 6, 4, 20, 56, 56, tzinfo=datetime.timezone.utc), 'display_name': 'image-926a4015-c327-4be7-9086-5cce1a8e0ebf', 'bootable': False, 'provider_id': None, 'terminated_at': None, 'cluster_name': None, 'replication_driver_data': None, 'previous_status': None, 'availability_zone': 'nova', 'metadata': {}, 'shared_targets': True, 'consistencygroup_id': None, 'launched_at': None, 'replication_status': None, 'volume_metadata': [], 'updated_at': datetime.datetime(2022, 6, 4, 20, 56, 56, tzinfo=datetime.timezone.utc), 'attach_status': 'detached', 'status': 'creating', 'source_volid': '7b6358b5-f2c7-4f84-93be-b0746120aafa'}. {{(pid=130490) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1620}} Jun 04 20:57:41.807631 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Volume reschedule parameters: False retry: None {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:57:41.836929 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Flow 'volume_create_manager' (83876a1c-cb8c-4cd4-b8af-20172e357d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:57:41.863074 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124446f1-d654-42ce-9bad-162b4e18d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:41.907307 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124446f1-d654-42ce-9bad-162b4e18d900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='image-926a4015-c327-4be7-9086-5cce1a8e0ebf',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9ae28598-c844-4fb8-8842-66d0fa33f643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36edf7db2659419aa39f259141009a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7b6358b5-f2c7-4f84-93be-b0746120aafa,status='creating',terminated_at=None,updated_at=2022-06-04T20:56:56Z,use_quota=True,user_id='ac8ef83fa94e4c9db70a0115cc867dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:41.923390 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd4648c-3ce0-4766-b61e-da02cb12e83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:41.937099 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd4648c-3ce0-4766-b61e-da02cb12e83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:41.951782 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae40743-76fa-45a8-a2c2-60bacb6409a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:41.988072 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae40743-76fa-45a8-a2c2-60bacb6409a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'volume_name': 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643', 'volume_size': 1, 'source_volid': '7b6358b5-f2c7-4f84-93be-b0746120aafa', 'source_volstatus': 'downloading'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:42.018300 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de30f3c1-b4ac-44cd-b3bb-1df5095ae883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:42.033233 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de30f3c1-b4ac-44cd-b3bb-1df5095ae883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:42.045986 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552c487b-1d81-46f5-bc07-9a7c73e8f04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:42.052400 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Volume 9ae28598-c844-4fb8-8842-66d0fa33f643: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643', 'volume_size': 1, 'source_volid': '7b6358b5-f2c7-4f84-93be-b0746120aafa', 'source_volstatus': 'downloading'} Jun 04 20:57:42.097984 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:42.182721 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] creating snapshot='volume-9ae28598-c844-4fb8-8842-66d0fa33f643.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 20:57:43.285540 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] cloning 'volume-7b6358b5-f2c7-4f84-93be-b0746120aafa@volume-9ae28598-c844-4fb8-8842-66d0fa33f643.clone_snap' to 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 20:57:43.349411 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:57:43.407245 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Flow 'volume_create_manager' (eb0addb9-be55-4953-a03b-997679394ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:57:43.424883 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc345fe-e71e-42eb-aa95-bb22bd50984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:43.469929 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc345fe-e71e-42eb-aa95-bb22bd50984b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1739900989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1265fb5b-83d5-4326-aba2-c668a0d9be63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b90f117684cff9d0ffccf630d8307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T20:57:43Z,use_quota=True,user_id='71d29871def3409f89efcda0e82a4ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:43.490337 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3044682-d818-4fa2-b5fe-7c8a52eead68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:43.498062 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3044682-d818-4fa2-b5fe-7c8a52eead68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:43.508690 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92da9e74-2329-474f-871c-e5c30292029b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:43.517760 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92da9e74-2329-474f-871c-e5c30292029b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1265fb5b-83d5-4326-aba2-c668a0d9be63', 'volume_name': 'volume-1265fb5b-83d5-4326-aba2-c668a0d9be63', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:43.530326 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f35d493-7dd8-4e48-a367-04733de292f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:43.534419 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f35d493-7dd8-4e48-a367-04733de292f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:43.538962 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a04cd56-0f7e-4e76-b700-f27c69bd0f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:43.558619 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Volume 1265fb5b-83d5-4326-aba2-c668a0d9be63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1265fb5b-83d5-4326-aba2-c668a0d9be63', 'volume_size': 1} Jun 04 20:57:43.560571 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] creating volume 'volume-1265fb5b-83d5-4326-aba2-c668a0d9be63' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 20:57:43.561717 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:43.652736 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 20:57:43.653777 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:57:43.654213 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:57:43.750100 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 20:57:43.756042 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552c487b-1d81-46f5-bc07-9a7c73e8f04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643', 'volume_size': 1, 'source_volid': '7b6358b5-f2c7-4f84-93be-b0746120aafa', 'source_volstatus': 'downloading'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:43.765442 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2032ef0f-54b1-49a5-825c-057ffb5ea3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:43.778501 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:57:43.779220 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:57:43.784336 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a04cd56-0f7e-4e76-b700-f27c69bd0f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1265fb5b-83d5-4326-aba2-c668a0d9be63', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:43.789601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2260cb9-3c5a-4e81-b14c-bf6ca1bb98e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:43.809965 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Volume volume-9ae28598-c844-4fb8-8842-66d0fa33f643 (9ae28598-c844-4fb8-8842-66d0fa33f643): created successfully Jun 04 20:57:43.849054 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2032ef0f-54b1-49a5-825c-057ffb5ea3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:43.880445 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Flow 'volume_create_manager' (83876a1c-cb8c-4cd4-b8af-20172e357d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:57:43.897706 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Volume volume-1265fb5b-83d5-4326-aba2-c668a0d9be63 (1265fb5b-83d5-4326-aba2-c668a0d9be63): created successfully Jun 04 20:57:43.902779 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2260cb9-3c5a-4e81-b14c-bf6ca1bb98e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:43.910411 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Flow 'volume_create_manager' (eb0addb9-be55-4953-a03b-997679394ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:57:43.923852 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Created volume successfully. Jun 04 20:57:43.934774 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a9de2b22-a54e-4bb0-bb9e-83f2ce243bdf tempest-VolumesAdminNegativeTest-685027402 None] Created volume successfully. Jun 04 20:57:44.022076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Creating new image-volume cache entry for image 926a4015-c327-4be7-9086-5cce1a8e0ebf on ncdv-master-1@ceph#ceph {{(pid=130490) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Jun 04 20:57:44.043869 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] New image-volume cache entry created: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 20, 57, 44, 28187)}. {{(pid=130490) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Jun 04 20:57:44.059399 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 47.417s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 20:57:44.059399 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Marking volume 7b6358b5-f2c7-4f84-93be-b0746120aafa as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 20:57:44.081956 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 7b6358b5-f2c7-4f84-93be-b0746120aafa. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 20:57:44.083312 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Creating volume glance metadata for volume 7b6358b5-f2c7-4f84-93be-b0746120aafa backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 20:57:44.256289 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12076b1-5c2d-49f1-9e95-3809e83cac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6358b5-f2c7-4f84-93be-b0746120aafa', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:44.270527 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95e05bd-b4e8-4f3c-90af-453d75f78a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:57:44.299034 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa (7b6358b5-f2c7-4f84-93be-b0746120aafa): created successfully Jun 04 20:57:44.306847 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95e05bd-b4e8-4f3c-90af-453d75f78a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:57:44.315779 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Flow 'volume_create_manager' (e31557a5-dbad-48e1-afbd-bb72b3de5661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:57:44.331351 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-52c81edb-f1b3-4440-aaf8-f842403cd149 tempest-LiveMigrationTest-647686994 None] Created volume successfully. Jun 04 20:57:45.341099 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:57:45.341807 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:45.477425 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:45.584350 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:57:45.614455 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-203c7a06-ffd6-409e-b2c5-a5d8d691050c tempest-VolumesAdminNegativeTest-685027402 None] Lock "b'cinder-1265fb5b-83d5-4326-aba2-c668a0d9be63-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 20:57:45.682746 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-203c7a06-ffd6-409e-b2c5-a5d8d691050c tempest-VolumesAdminNegativeTest-685027402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:45.796156 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-203c7a06-ffd6-409e-b2c5-a5d8d691050c tempest-VolumesAdminNegativeTest-685027402 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 20:57:45.796584 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-203c7a06-ffd6-409e-b2c5-a5d8d691050c tempest-VolumesAdminNegativeTest-685027402 None] Volume volume-1265fb5b-83d5-4326-aba2-c668a0d9be63 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 20:57:45.813326 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-203c7a06-ffd6-409e-b2c5-a5d8d691050c tempest-VolumesAdminNegativeTest-685027402 None] deleting rbd volume volume-1265fb5b-83d5-4326-aba2-c668a0d9be63 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 20:57:46.355111 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-203c7a06-ffd6-409e-b2c5-a5d8d691050c tempest-VolumesAdminNegativeTest-685027402 None] Created reservations ['285001ac-636e-4f3a-8ec0-77a3293e605c', 'c761f2a1-9beb-4c64-9910-fef5bcb603eb', '01a6901c-106c-49af-bf9e-d67c72ae6007', 'cad0b038-28e8-45cc-bf15-6c01b782c62b'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 20:57:46.547356 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-203c7a06-ffd6-409e-b2c5-a5d8d691050c tempest-VolumesAdminNegativeTest-685027402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:46.610556 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-203c7a06-ffd6-409e-b2c5-a5d8d691050c tempest-VolumesAdminNegativeTest-685027402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:46.672035 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-203c7a06-ffd6-409e-b2c5-a5d8d691050c tempest-VolumesAdminNegativeTest-685027402 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:57:46.676024 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-203c7a06-ffd6-409e-b2c5-a5d8d691050c tempest-VolumesAdminNegativeTest-685027402 None] Deleted volume successfully. Jun 04 20:57:46.705851 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-203c7a06-ffd6-409e-b2c5-a5d8d691050c tempest-VolumesAdminNegativeTest-685027402 None] Lock "b'cinder-1265fb5b-83d5-4326-aba2-c668a0d9be63-delete_volume'" released by "delete_volume" :: held 1.090s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 20:57:51.205122 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-05bfb250-85d5-4d31-b413-f63901a62204 req-b1e199e8-2a6f-462f-8c58-f0aea6142436 tempest-LiveMigrationTest-647686994 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:57:52.907162 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-05bfb250-85d5-4d31-b413-f63901a62204 req-b1e199e8-2a6f-462f-8c58-f0aea6142436 tempest-LiveMigrationTest-647686994 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.702s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:57:52.908028 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-05bfb250-85d5-4d31-b413-f63901a62204 req-b1e199e8-2a6f-462f-8c58-f0aea6142436 tempest-LiveMigrationTest-647686994 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7b6358b5-f2c7-4f84-93be-b0746120aafa', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '7b6358b5-f2c7-4f84-93be-b0746120aafa', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 20:57:52.937801 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=60,cinder:INSERT=17,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:52.947170 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-05bfb250-85d5-4d31-b413-f63901a62204 req-b1e199e8-2a6f-462f-8c58-f0aea6142436 tempest-LiveMigrationTest-647686994 None] Connection info returned from driver {'name': 'volumes/volume-7b6358b5-f2c7-4f84-93be-b0746120aafa', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7b6358b5-f2c7-4f84-93be-b0746120aafa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3c70474e-8bd2-47d2-baef-952ef37c02a7'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 20:57:53.043445 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-05bfb250-85d5-4d31-b413-f63901a62204 req-b1e199e8-2a6f-462f-8c58-f0aea6142436 tempest-LiveMigrationTest-647686994 None] attachment_update completed successfully. Jun 04 20:57:53.363437 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-b676bb6a-807a-44d8-9598-e89674699831 tempest-VolumesAdminNegativeTest-685027402 None] Lock "b'cinder-726addd0-8ade-4bdb-9f22-f610d44a32e9-delete_volume'" acquired by "delete_volume" :: waited 0.062s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 20:57:53.449558 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=21,cinder:SELECT=66,cinder:INSERT=11,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:53.490252 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b676bb6a-807a-44d8-9598-e89674699831 tempest-VolumesAdminNegativeTest-685027402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:53.634865 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b676bb6a-807a-44d8-9598-e89674699831 tempest-VolumesAdminNegativeTest-685027402 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 20:57:53.636162 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b676bb6a-807a-44d8-9598-e89674699831 tempest-VolumesAdminNegativeTest-685027402 None] Volume volume-726addd0-8ade-4bdb-9f22-f610d44a32e9 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 20:57:53.652728 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b676bb6a-807a-44d8-9598-e89674699831 tempest-VolumesAdminNegativeTest-685027402 None] deleting rbd volume volume-726addd0-8ade-4bdb-9f22-f610d44a32e9 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 20:57:54.242718 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-b676bb6a-807a-44d8-9598-e89674699831 tempest-VolumesAdminNegativeTest-685027402 None] Created reservations ['ea6cbda9-4e6d-49cc-9f04-4026f6272209', 'fbb431ed-b645-43f2-abd0-c9e9a9ca8eab', 'e56107bc-677c-4cdb-8b65-3ac17dff3ea9', 'f01303f4-d7ea-4b15-8e61-4f2e7d82f35f'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 20:57:54.313809 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b676bb6a-807a-44d8-9598-e89674699831 tempest-VolumesAdminNegativeTest-685027402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:54.374813 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b676bb6a-807a-44d8-9598-e89674699831 tempest-VolumesAdminNegativeTest-685027402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:57:54.470592 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-b676bb6a-807a-44d8-9598-e89674699831 tempest-VolumesAdminNegativeTest-685027402 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:57:54.487662 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b676bb6a-807a-44d8-9598-e89674699831 tempest-VolumesAdminNegativeTest-685027402 None] Deleted volume successfully. Jun 04 20:57:54.526515 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-b676bb6a-807a-44d8-9598-e89674699831 tempest-VolumesAdminNegativeTest-685027402 None] Lock "b'cinder-726addd0-8ade-4bdb-9f22-f610d44a32e9-delete_volume'" released by "delete_volume" :: held 1.163s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 20:58:04.517422 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:19.895164 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-f9edb58c-2e65-4443-bd81-d054963d6b36 req-72d80eb8-f88c-49b6-b7f5-520529587b3c tempest-LiveMigrationTest-1887059151 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:58:20.940964 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-f9edb58c-2e65-4443-bd81-d054963d6b36 req-72d80eb8-f88c-49b6-b7f5-520529587b3c tempest-LiveMigrationTest-1887059151 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.046s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:58:20.941761 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-f9edb58c-2e65-4443-bd81-d054963d6b36 req-72d80eb8-f88c-49b6-b7f5-520529587b3c tempest-LiveMigrationTest-1887059151 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7b6358b5-f2c7-4f84-93be-b0746120aafa', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '7b6358b5-f2c7-4f84-93be-b0746120aafa', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 20:58:20.976856 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-f9edb58c-2e65-4443-bd81-d054963d6b36 req-72d80eb8-f88c-49b6-b7f5-520529587b3c tempest-LiveMigrationTest-1887059151 None] Connection info returned from driver {'name': 'volumes/volume-7b6358b5-f2c7-4f84-93be-b0746120aafa', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7b6358b5-f2c7-4f84-93be-b0746120aafa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9ebfb2ff-9c2e-4f88-8d3d-a7aa4440e9bd'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 20:58:21.064224 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-f9edb58c-2e65-4443-bd81-d054963d6b36 req-72d80eb8-f88c-49b6-b7f5-520529587b3c tempest-LiveMigrationTest-1887059151 None] attachment_update completed successfully. Jun 04 20:58:24.486179 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=23,cinder:INSERT=3,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:26.172076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:58:26.192342 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Flow 'volume_create_manager' (457786b9-9ad0-403c-b854-d97292d06b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:58:26.198899 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3616a7ac-72c2-47be-a834-4c04f5111a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:26.215076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3616a7ac-72c2-47be-a834-4c04f5111a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1081102488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=57211fbb-e5c5-4cac-abe8-b47d9d3eac1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867cd3b05ecb4c93a28ab7a55928789b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T20:58:26Z,use_quota=True,user_id='be44957fa2304f52a8d34bdac9eaca4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:26.220190 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d79a53-f853-4666-a0f2-1b9a7a0459a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:26.224261 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d79a53-f853-4666-a0f2-1b9a7a0459a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:26.229642 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be584b96-8296-4f39-b499-61556b256193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:26.233718 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be584b96-8296-4f39-b499-61556b256193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57211fbb-e5c5-4cac-abe8-b47d9d3eac1e', 'volume_name': 'volume-57211fbb-e5c5-4cac-abe8-b47d9d3eac1e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:26.238489 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ddc841-b0d0-4471-bd94-42a43557bf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:26.242233 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ddc841-b0d0-4471-bd94-42a43557bf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:26.247103 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41500652-7633-47bb-ab32-0729bf621ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:26.248186 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Volume 57211fbb-e5c5-4cac-abe8-b47d9d3eac1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57211fbb-e5c5-4cac-abe8-b47d9d3eac1e', 'volume_size': 1} Jun 04 20:58:26.248588 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] creating volume 'volume-57211fbb-e5c5-4cac-abe8-b47d9d3eac1e' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 20:58:26.249549 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:58:26.313707 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:58:26.314328 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:58:26.317881 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41500652-7633-47bb-ab32-0729bf621ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57211fbb-e5c5-4cac-abe8-b47d9d3eac1e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:26.323082 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af47a5d1-f9c3-41b2-aa0d-0c5195aad6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:26.341121 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Volume volume-57211fbb-e5c5-4cac-abe8-b47d9d3eac1e (57211fbb-e5c5-4cac-abe8-b47d9d3eac1e): created successfully Jun 04 20:58:26.345524 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af47a5d1-f9c3-41b2-aa0d-0c5195aad6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:26.351955 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Flow 'volume_create_manager' (457786b9-9ad0-403c-b854-d97292d06b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:58:26.364881 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-32cca7b8-aef8-4846-9bea-820986c18ac0 tempest-ServerRescueNegativeTestJSON-131796696 None] Created volume successfully. Jun 04 20:58:31.457825 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-f9edb58c-2e65-4443-bd81-d054963d6b36 req-a71e128d-43c8-43f7-bef3-0a3c29aa22d6 tempest-LiveMigrationTest-1887059151 None] Terminate volume connection completed successfully. Jun 04 20:58:31.458490 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-f9edb58c-2e65-4443-bd81-d054963d6b36 req-a71e128d-43c8-43f7-bef3-0a3c29aa22d6 tempest-LiveMigrationTest-1887059151 None] Deleting attachment 3c70474e-8bd2-47d2-baef-952ef37c02a7. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 20:58:43.186638 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=25,cinder:UPDATE=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:43.189847 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-1c1c0b4d-10e1-40af-8555-9f0837fb66cd tempest-LiveMigrationTest-647686994 None] Terminate volume connection completed successfully. Jun 04 20:58:43.190585 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-1c1c0b4d-10e1-40af-8555-9f0837fb66cd tempest-LiveMigrationTest-647686994 None] Deleting attachment 9ebfb2ff-9c2e-4f88-8d3d-a7aa4440e9bd. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 20:58:43.499733 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-87373d69-51ef-42e1-a106-7778dacf506a tempest-LiveMigrationTest-647686994 None] Lock "b'cinder-7b6358b5-f2c7-4f84-93be-b0746120aafa-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 20:58:43.615482 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-87373d69-51ef-42e1-a106-7778dacf506a tempest-LiveMigrationTest-647686994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:58:43.717864 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-87373d69-51ef-42e1-a106-7778dacf506a tempest-LiveMigrationTest-647686994 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 20:58:43.718251 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-87373d69-51ef-42e1-a106-7778dacf506a tempest-LiveMigrationTest-647686994 None] volume has clone snapshot(s) {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1294}} Jun 04 20:58:43.720103 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-87373d69-51ef-42e1-a106-7778dacf506a tempest-LiveMigrationTest-647686994 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 20:58:44.012304 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-87373d69-51ef-42e1-a106-7778dacf506a tempest-LiveMigrationTest-647686994 None] Created reservations ['86ca8730-73ef-4497-8cc5-66836aafae25', '16f253f4-468a-41b9-80ff-a49cc1bfe39b', 'dd8c9a73-f30d-4c45-aa2a-5957e8c48d00', '6b0d2cfe-2226-4527-abc5-33fe584a2d75'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 20:58:44.137793 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-87373d69-51ef-42e1-a106-7778dacf506a tempest-LiveMigrationTest-647686994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:58:44.223565 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-87373d69-51ef-42e1-a106-7778dacf506a tempest-LiveMigrationTest-647686994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:58:44.316076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-87373d69-51ef-42e1-a106-7778dacf506a tempest-LiveMigrationTest-647686994 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:58:44.321412 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-87373d69-51ef-42e1-a106-7778dacf506a tempest-LiveMigrationTest-647686994 None] Deleted volume successfully. Jun 04 20:58:44.354686 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a req-87373d69-51ef-42e1-a106-7778dacf506a tempest-LiveMigrationTest-647686994 None] Lock "b'cinder-7b6358b5-f2c7-4f84-93be-b0746120aafa-delete_volume'" released by "delete_volume" :: held 0.855s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 20:58:45.340194 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:58:45.340871 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:58:45.418334 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:58:45.477954 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:58:45.504831 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-538b3e0d-5340-4001-8b9f-4d70697f03c0 tempest-LiveMigrationTest-647686994 None] Lock "b'cinder-94b159b1-5ff2-48ce-8547-8af2ac101852-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 20:58:45.565572 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-538b3e0d-5340-4001-8b9f-4d70697f03c0 tempest-LiveMigrationTest-647686994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:58:45.666283 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-538b3e0d-5340-4001-8b9f-4d70697f03c0 tempest-LiveMigrationTest-647686994 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 20:58:45.666995 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-538b3e0d-5340-4001-8b9f-4d70697f03c0 tempest-LiveMigrationTest-647686994 None] Volume volume-94b159b1-5ff2-48ce-8547-8af2ac101852 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 20:58:45.685366 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-538b3e0d-5340-4001-8b9f-4d70697f03c0 tempest-LiveMigrationTest-647686994 None] deleting rbd volume volume-94b159b1-5ff2-48ce-8547-8af2ac101852 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 20:58:46.215384 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-538b3e0d-5340-4001-8b9f-4d70697f03c0 tempest-LiveMigrationTest-647686994 None] Created reservations ['a7a22f35-e1f3-4586-910f-ff4df93e2baf', 'ea31f9ff-c788-4c59-8800-23276a45ca17', '08f7e56b-5326-4571-948e-213b00ea89c2', 'a34dab05-5f34-4de4-a875-f54163eb4adb'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 20:58:46.332038 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-538b3e0d-5340-4001-8b9f-4d70697f03c0 tempest-LiveMigrationTest-647686994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:58:46.426491 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-538b3e0d-5340-4001-8b9f-4d70697f03c0 tempest-LiveMigrationTest-647686994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:58:46.504755 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-538b3e0d-5340-4001-8b9f-4d70697f03c0 tempest-LiveMigrationTest-647686994 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:58:46.517054 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-538b3e0d-5340-4001-8b9f-4d70697f03c0 tempest-LiveMigrationTest-647686994 None] Deleted volume successfully. Jun 04 20:58:46.579774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-538b3e0d-5340-4001-8b9f-4d70697f03c0 tempest-LiveMigrationTest-647686994 None] Lock "b'cinder-94b159b1-5ff2-48ce-8547-8af2ac101852-delete_volume'" released by "delete_volume" :: held 1.075s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 20:58:53.981299 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:58:54.007235 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Flow 'volume_create_manager' (91a1ed5c-8961-445f-9c93-2260a5824f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:58:54.014592 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39b05b7-bc45-4990-90b6-ab106fb3e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:54.037366 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39b05b7-bc45-4990-90b6-ab106fb3e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-1645163474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=40e4e2d0-1a42-4e71-9df7-e2abd0414e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5ccb3a1d6f4f9e9eaad08d25ce57fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T20:58:54Z,use_quota=True,user_id='e25328c90d26437a85d8d5509437ed99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:54.046653 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbad4f3d-5a2a-44eb-bb35-22b1b1bef879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:54.053206 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbad4f3d-5a2a-44eb-bb35-22b1b1bef879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:54.063661 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebe9409-e87a-4da0-911f-97523bde20d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:54.067866 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebe9409-e87a-4da0-911f-97523bde20d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'volume_name': 'volume-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:54.073024 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2bd631-65f4-4369-9cad-99a20dee5cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:54.077286 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2bd631-65f4-4369-9cad-99a20dee5cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:54.081967 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69853725-3bcd-4678-a3d0-26ce90818f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:54.083220 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Volume 40e4e2d0-1a42-4e71-9df7-e2abd0414e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'volume_size': 1} Jun 04 20:58:54.083823 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] creating volume 'volume-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 20:58:54.084748 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:58:54.214988 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:58:54.215559 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:58:54.219332 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69853725-3bcd-4678-a3d0-26ce90818f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:54.224426 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8be95b-c275-407b-9d5c-d752517a94b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:58:54.239684 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Volume volume-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f (40e4e2d0-1a42-4e71-9df7-e2abd0414e4f): created successfully Jun 04 20:58:54.243631 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8be95b-c275-407b-9d5c-d752517a94b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:58:54.250583 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Flow 'volume_create_manager' (91a1ed5c-8961-445f-9c93-2260a5824f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:58:54.261732 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e9dbbd6b-bb2a-42d4-ade9-c6fded234757 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Created volume successfully. Jun 04 20:58:57.012044 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=40,cinder:UPDATE=17,cinder:DELETE=3,cinder:INSERT=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:57.022671 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-28358e06-9bbf-49a1-92f1-a7903388e997 req-07317bb8-f760-4982-a483-9a93d839126d tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:58:58.047743 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-28358e06-9bbf-49a1-92f1-a7903388e997 req-07317bb8-f760-4982-a483-9a93d839126d tempest-LiveAutoBlockMigrationV225Test-1858155877 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.023s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:58:58.049553 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-28358e06-9bbf-49a1-92f1-a7903388e997 req-07317bb8-f760-4982-a483-9a93d839126d tempest-LiveAutoBlockMigrationV225Test-1858155877 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 20:58:58.089770 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-28358e06-9bbf-49a1-92f1-a7903388e997 req-07317bb8-f760-4982-a483-9a93d839126d tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Connection info returned from driver {'name': 'volumes/volume-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f58892b5-2931-447e-a6ab-84770a60d8cc'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 20:58:58.190633 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-28358e06-9bbf-49a1-92f1-a7903388e997 req-07317bb8-f760-4982-a483-9a93d839126d tempest-LiveAutoBlockMigrationV225Test-1858155877 None] attachment_update completed successfully. Jun 04 20:59:02.909582 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:59:02.943977 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Flow 'volume_create_manager' (ac5899a6-589e-4da7-b7fb-0ae210f51db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:59:02.951221 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b73c1a2-5069-442c-bd55-fd3c652a9d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:02.976849 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b73c1a2-5069-442c-bd55-fd3c652a9d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1646624806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=37cf4b6a-6b9d-4adb-8221-172f88294ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867cd3b05ecb4c93a28ab7a55928789b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T20:59:03Z,use_quota=True,user_id='be44957fa2304f52a8d34bdac9eaca4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:02.983768 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc06fe97-a866-47eb-9f99-b14f4864f9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:02.987839 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc06fe97-a866-47eb-9f99-b14f4864f9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:02.992815 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3366288-af7a-42c5-bafa-1547a7a91701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:02.996833 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3366288-af7a-42c5-bafa-1547a7a91701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37cf4b6a-6b9d-4adb-8221-172f88294ef6', 'volume_name': 'volume-37cf4b6a-6b9d-4adb-8221-172f88294ef6', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:03.001585 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf55dce-dd9d-48de-a204-3dcf3e801cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:03.006927 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf55dce-dd9d-48de-a204-3dcf3e801cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:03.012188 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a502719-43e7-4599-ba73-6caf90e8edda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:03.013497 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Volume 37cf4b6a-6b9d-4adb-8221-172f88294ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37cf4b6a-6b9d-4adb-8221-172f88294ef6', 'volume_size': 1} Jun 04 20:59:03.015272 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] creating volume 'volume-37cf4b6a-6b9d-4adb-8221-172f88294ef6' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 20:59:03.016115 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:59:03.144724 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:59:03.145221 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:59:03.151004 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a502719-43e7-4599-ba73-6caf90e8edda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37cf4b6a-6b9d-4adb-8221-172f88294ef6', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:03.157191 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd456ed-db28-4df4-bc72-b575c2cfc985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:03.177217 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Volume volume-37cf4b6a-6b9d-4adb-8221-172f88294ef6 (37cf4b6a-6b9d-4adb-8221-172f88294ef6): created successfully Jun 04 20:59:03.182569 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd456ed-db28-4df4-bc72-b575c2cfc985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:03.193287 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Flow 'volume_create_manager' (ac5899a6-589e-4da7-b7fb-0ae210f51db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:59:03.208118 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-339f9591-04d8-4780-9423-4dd3a229df95 tempest-ServerRescueNegativeTestJSON-131796696 None] Created volume successfully. Jun 04 20:59:13.751291 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=46,cinder:INSERT=4,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:13.778783 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-5a80fd84-2296-41e0-b04f-49d3afd15537 req-0aca5420-29dd-4312-928d-f129901cb3f5 tempest-LiveAutoBlockMigrationV225Test-617269557 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:59:14.575766 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-5a80fd84-2296-41e0-b04f-49d3afd15537 req-0aca5420-29dd-4312-928d-f129901cb3f5 tempest-LiveAutoBlockMigrationV225Test-617269557 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.795s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:59:14.576489 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-5a80fd84-2296-41e0-b04f-49d3afd15537 req-0aca5420-29dd-4312-928d-f129901cb3f5 tempest-LiveAutoBlockMigrationV225Test-617269557 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 20:59:14.603477 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-5a80fd84-2296-41e0-b04f-49d3afd15537 req-0aca5420-29dd-4312-928d-f129901cb3f5 tempest-LiveAutoBlockMigrationV225Test-617269557 None] Connection info returned from driver {'name': 'volumes/volume-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '40e4e2d0-1a42-4e71-9df7-e2abd0414e4f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '08cc50ad-d4aa-43e3-b4dd-8c6215cd5715'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 20:59:14.667392 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-5a80fd84-2296-41e0-b04f-49d3afd15537 req-0aca5420-29dd-4312-928d-f129901cb3f5 tempest-LiveAutoBlockMigrationV225Test-617269557 None] attachment_update completed successfully. Jun 04 20:59:26.689990 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-5a80fd84-2296-41e0-b04f-49d3afd15537 req-b7209307-1c96-47b9-b6eb-63dfae323efc tempest-LiveAutoBlockMigrationV225Test-617269557 None] Terminate volume connection completed successfully. Jun 04 20:59:26.690640 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-5a80fd84-2296-41e0-b04f-49d3afd15537 req-b7209307-1c96-47b9-b6eb-63dfae323efc tempest-LiveAutoBlockMigrationV225Test-617269557 None] Deleting attachment f58892b5-2931-447e-a6ab-84770a60d8cc. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 20:59:34.482190 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=39,cinder:UPDATE=7 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:39.213641 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-cf91187e-cb18-475c-a7ac-0a9c37d2cb60 req-d1201124-e1c2-44a9-9b8e-22d9241c226a tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Terminate volume connection completed successfully. Jun 04 20:59:39.214396 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-cf91187e-cb18-475c-a7ac-0a9c37d2cb60 req-d1201124-e1c2-44a9-9b8e-22d9241c226a tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Deleting attachment 08cc50ad-d4aa-43e3-b4dd-8c6215cd5715. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 20:59:40.877990 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:59:40.903338 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Flow 'volume_create_manager' (9cf2b18b-f02f-4f16-b25b-2ed49259171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:59:40.910680 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5154e964-680a-45e2-bfd3-585402fa47ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:40.928674 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5154e964-680a-45e2-bfd3-585402fa47ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1277927075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=153e56ad-00b6-438f-923c-903891b5c847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5ccb3a1d6f4f9e9eaad08d25ce57fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T20:59:41Z,use_quota=True,user_id='e25328c90d26437a85d8d5509437ed99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:40.935823 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e521cbdd-3120-416e-b680-8b8f831bd60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:40.940613 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e521cbdd-3120-416e-b680-8b8f831bd60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:40.948164 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07288267-44fa-4fa1-8f68-bd7a50b540fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:41.072695 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07288267-44fa-4fa1-8f68-bd7a50b540fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '153e56ad-00b6-438f-923c-903891b5c847', 'volume_name': 'volume-153e56ad-00b6-438f-923c-903891b5c847', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:41.085330 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441234da-10bf-45f9-b785-09433054af47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:41.094001 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441234da-10bf-45f9-b785-09433054af47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:41.108952 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff396674-c75a-430f-b7f9-d26c2324a652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:41.110817 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Volume 153e56ad-00b6-438f-923c-903891b5c847: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-153e56ad-00b6-438f-923c-903891b5c847', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 20:59:41.119797 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Cloning 153e56ad-00b6-438f-923c-903891b5c847 from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 20:59:41.130651 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 20:59:41.148521 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 20, 59, 41, 137334)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 20:59:41.149436 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 20:59:41.150136 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 20:59:41.157773 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.027s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 20:59:41.159072 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 20:59:41.165780 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 20, 59, 41, 162987)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 20:59:41.166488 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 20:59:41.167067 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 20:59:41.182599 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:59:41.315614 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] creating snapshot='volume-153e56ad-00b6-438f-923c-903891b5c847.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 20:59:42.357992 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-153e56ad-00b6-438f-923c-903891b5c847.clone_snap' to 'volume-153e56ad-00b6-438f-923c-903891b5c847' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 20:59:42.588990 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 20:59:42.590636 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:59:42.591182 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:59:42.630041 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 20:59:42.631195 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Marking volume 153e56ad-00b6-438f-923c-903891b5c847 as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 20:59:42.650912 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 153e56ad-00b6-438f-923c-903891b5c847. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 20:59:42.651761 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Creating volume glance metadata for volume 153e56ad-00b6-438f-923c-903891b5c847 backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 20:59:42.739851 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff396674-c75a-430f-b7f9-d26c2324a652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153e56ad-00b6-438f-923c-903891b5c847', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:42.747600 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed5faca-2e98-4593-add0-9a7be8448cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:42.773460 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Volume volume-153e56ad-00b6-438f-923c-903891b5c847 (153e56ad-00b6-438f-923c-903891b5c847): created successfully Jun 04 20:59:42.777573 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed5faca-2e98-4593-add0-9a7be8448cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:42.792067 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Flow 'volume_create_manager' (9cf2b18b-f02f-4f16-b25b-2ed49259171c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:59:42.808027 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-bafc009b-e549-4bff-a4c9-acf5ae373fc7 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Created volume successfully. Jun 04 20:59:44.489261 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=29,cinder:UPDATE=7,cinder:INSERT=7 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:45.337599 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 20:59:45.338656 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:59:45.406885 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:59:45.488005 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 20:59:46.219812 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:59:46.292849 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Flow 'volume_create_manager' (0598b9ea-a2a7-44d1-84bb-9a46c78eade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:59:46.325716 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72552ff7-0b7c-40a2-8e0d-9c58502181a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:46.397345 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72552ff7-0b7c-40a2-8e0d-9c58502181a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1227018443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ac96704a-67df-48a9-a9a6-4111f08c7fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13a926a61e0412c8eae94528aeb0a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T20:59:46Z,use_quota=True,user_id='425dba3904234fc08c2913a4e299b003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:46.408963 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b083190-72d0-404e-a131-92020977cd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:46.423939 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b083190-72d0-404e-a131-92020977cd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:46.429330 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d15463-548a-48fe-a160-640a3f71ef4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:46.447925 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d15463-548a-48fe-a160-640a3f71ef4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac96704a-67df-48a9-a9a6-4111f08c7fdb', 'volume_name': 'volume-ac96704a-67df-48a9-a9a6-4111f08c7fdb', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:46.484908 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9c2f56-8c41-4757-98eb-8c0e9f2b919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:46.496823 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9c2f56-8c41-4757-98eb-8c0e9f2b919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:46.501568 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26152ad4-dc64-4ce3-97a1-3922459263d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:46.515911 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Volume ac96704a-67df-48a9-a9a6-4111f08c7fdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac96704a-67df-48a9-a9a6-4111f08c7fdb', 'volume_size': 1} Jun 04 20:59:46.516903 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] creating volume 'volume-ac96704a-67df-48a9-a9a6-4111f08c7fdb' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 20:59:46.517743 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:59:46.715624 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:59:46.716319 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:59:46.720113 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26152ad4-dc64-4ce3-97a1-3922459263d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac96704a-67df-48a9-a9a6-4111f08c7fdb', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:46.741130 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0670e5e-5aa5-47e4-95b8-9d22de2e6690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:46.787981 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Volume volume-ac96704a-67df-48a9-a9a6-4111f08c7fdb (ac96704a-67df-48a9-a9a6-4111f08c7fdb): created successfully Jun 04 20:59:46.793412 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0670e5e-5aa5-47e4-95b8-9d22de2e6690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:46.803484 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Flow 'volume_create_manager' (0598b9ea-a2a7-44d1-84bb-9a46c78eade2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:59:46.820783 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-776a0a48-5c9a-4674-9125-c5b47bd6be75 tempest-ServersNegativeTestJSON-1931291149 None] Created volume successfully. Jun 04 20:59:48.575163 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-b0f569e4-8571-4a65-9bed-59f53d0962c6 req-e3126bdc-663f-4681-890e-9742771c34f8 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 20:59:49.874302 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-b0f569e4-8571-4a65-9bed-59f53d0962c6 req-e3126bdc-663f-4681-890e-9742771c34f8 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.299s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 20:59:49.876373 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-b0f569e4-8571-4a65-9bed-59f53d0962c6 req-e3126bdc-663f-4681-890e-9742771c34f8 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-153e56ad-00b6-438f-923c-903891b5c847', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '153e56ad-00b6-438f-923c-903891b5c847', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 20:59:49.935416 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-b0f569e4-8571-4a65-9bed-59f53d0962c6 req-e3126bdc-663f-4681-890e-9742771c34f8 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Connection info returned from driver {'name': 'volumes/volume-153e56ad-00b6-438f-923c-903891b5c847', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '153e56ad-00b6-438f-923c-903891b5c847', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f2c9a4b4-2301-4567-a786-37f9361d4b5d'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 20:59:50.029634 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-b0f569e4-8571-4a65-9bed-59f53d0962c6 req-e3126bdc-663f-4681-890e-9742771c34f8 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] attachment_update completed successfully. Jun 04 20:59:52.307537 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 20:59:52.359359 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Flow 'volume_create_manager' (1c31154f-c0f4-477d-a63f-4cb5907f32b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:59:52.376790 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45c9a3f-9677-4663-93e4-296ea33c69ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:52.428370 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45c9a3f-9677-4663-93e4-296ea33c69ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T20:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1878600811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=30a79c1e-eb28-4879-87bc-0d6a7f76e1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13a926a61e0412c8eae94528aeb0a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T20:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T20:59:52Z,use_quota=True,user_id='425dba3904234fc08c2913a4e299b003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:52.443996 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea815d6-0286-46f5-96a9-e4372570b033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:52.462760 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea815d6-0286-46f5-96a9-e4372570b033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:52.470934 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23135e2a-2807-48ab-a826-92ac2e487f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:52.476569 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23135e2a-2807-48ab-a826-92ac2e487f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a79c1e-eb28-4879-87bc-0d6a7f76e1eb', 'volume_name': 'volume-30a79c1e-eb28-4879-87bc-0d6a7f76e1eb', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:52.484311 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a0ec06-3acc-4300-b7b9-417e185f7739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:52.489329 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a0ec06-3acc-4300-b7b9-417e185f7739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:52.495397 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9d9708-7c2c-4268-a23b-7a747cfd0478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:52.496926 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Volume 30a79c1e-eb28-4879-87bc-0d6a7f76e1eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a79c1e-eb28-4879-87bc-0d6a7f76e1eb', 'volume_size': 1} Jun 04 20:59:52.497571 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] creating volume 'volume-30a79c1e-eb28-4879-87bc-0d6a7f76e1eb' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 20:59:52.498559 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 20:59:52.637115 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 20:59:52.637802 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 20:59:52.642841 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9d9708-7c2c-4268-a23b-7a747cfd0478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a79c1e-eb28-4879-87bc-0d6a7f76e1eb', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:52.650128 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8afa14-e68f-432c-be16-2d1fbf5acaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 20:59:52.677064 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Volume volume-30a79c1e-eb28-4879-87bc-0d6a7f76e1eb (30a79c1e-eb28-4879-87bc-0d6a7f76e1eb): created successfully Jun 04 20:59:52.686399 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8afa14-e68f-432c-be16-2d1fbf5acaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 20:59:52.701158 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Flow 'volume_create_manager' (1c31154f-c0f4-477d-a63f-4cb5907f32b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 20:59:52.716623 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-10014ffa-a72e-4f54-af61-99e5cd25bc0e tempest-ServersNegativeTestJSON-1931291149 None] Created volume successfully. Jun 04 21:00:12.178114 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=41,cinder:UPDATE=10,cinder:INSERT=5,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:12.184975 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-3b6437b9-f7d1-4de9-ba51-0f21325af88c req-fe9a0926-2903-4792-9bf4-e796144b0c9d tempest-LiveAutoBlockMigrationV225Test-617269557 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:00:13.111553 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-3b6437b9-f7d1-4de9-ba51-0f21325af88c req-fe9a0926-2903-4792-9bf4-e796144b0c9d tempest-LiveAutoBlockMigrationV225Test-617269557 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.926s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:00:13.112687 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-3b6437b9-f7d1-4de9-ba51-0f21325af88c req-fe9a0926-2903-4792-9bf4-e796144b0c9d tempest-LiveAutoBlockMigrationV225Test-617269557 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-153e56ad-00b6-438f-923c-903891b5c847', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '153e56ad-00b6-438f-923c-903891b5c847', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:00:13.151279 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3b6437b9-f7d1-4de9-ba51-0f21325af88c req-fe9a0926-2903-4792-9bf4-e796144b0c9d tempest-LiveAutoBlockMigrationV225Test-617269557 None] Connection info returned from driver {'name': 'volumes/volume-153e56ad-00b6-438f-923c-903891b5c847', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '153e56ad-00b6-438f-923c-903891b5c847', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8f389c15-88db-496e-a4ca-74ad54890bfe'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:00:13.265191 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-3b6437b9-f7d1-4de9-ba51-0f21325af88c req-fe9a0926-2903-4792-9bf4-e796144b0c9d tempest-LiveAutoBlockMigrationV225Test-617269557 None] attachment_update completed successfully. Jun 04 21:00:14.196512 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-e19d9e78-2665-48b6-81b7-a9a8da732340 req-3b1675f0-3f18-449f-9af2-eefe30b46fe0 tempest-ServerRescueNegativeTestJSON-131796696 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:00:15.058911 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-e19d9e78-2665-48b6-81b7-a9a8da732340 req-3b1675f0-3f18-449f-9af2-eefe30b46fe0 tempest-ServerRescueNegativeTestJSON-131796696 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.863s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:00:15.060462 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-e19d9e78-2665-48b6-81b7-a9a8da732340 req-3b1675f0-3f18-449f-9af2-eefe30b46fe0 tempest-ServerRescueNegativeTestJSON-131796696 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-37cf4b6a-6b9d-4adb-8221-172f88294ef6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '37cf4b6a-6b9d-4adb-8221-172f88294ef6', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:00:15.093960 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=47,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:15.126913 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-e19d9e78-2665-48b6-81b7-a9a8da732340 req-3b1675f0-3f18-449f-9af2-eefe30b46fe0 tempest-ServerRescueNegativeTestJSON-131796696 None] Connection info returned from driver {'name': 'volumes/volume-37cf4b6a-6b9d-4adb-8221-172f88294ef6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '37cf4b6a-6b9d-4adb-8221-172f88294ef6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5b7cc13b-7190-4274-8c90-e06b10c6ff2a'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:00:15.195695 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-e19d9e78-2665-48b6-81b7-a9a8da732340 req-3b1675f0-3f18-449f-9af2-eefe30b46fe0 tempest-ServerRescueNegativeTestJSON-131796696 None] attachment_update completed successfully. Jun 04 21:00:22.028769 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-3b6437b9-f7d1-4de9-ba51-0f21325af88c req-5fd2b577-df60-4fae-9f28-e1a2448538e7 tempest-LiveAutoBlockMigrationV225Test-617269557 None] Terminate volume connection completed successfully. Jun 04 21:00:22.029442 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3b6437b9-f7d1-4de9-ba51-0f21325af88c req-5fd2b577-df60-4fae-9f28-e1a2448538e7 tempest-LiveAutoBlockMigrationV225Test-617269557 None] Deleting attachment f2c9a4b4-2301-4567-a786-37f9361d4b5d. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:00:32.028938 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:34.024457 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-e276627a-1971-4f78-8ac1-09a16b5fca8d tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Terminate volume connection completed successfully. Jun 04 21:00:34.025217 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-e276627a-1971-4f78-8ac1-09a16b5fca8d tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Deleting attachment 8f389c15-88db-496e-a4ca-74ad54890bfe. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:00:34.667187 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Lock "b'cinder-153e56ad-00b6-438f-923c-903891b5c847-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:00:34.757080 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:00:34.906461 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:00:34.930348 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] deleting rbd volume volume-153e56ad-00b6-438f-923c-903891b5c847 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:00:35.292224 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:00:35.336440 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] deleting parent snapshot volume-153e56ad-00b6-438f-923c-903891b5c847.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:00:36.392750 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d1b8f3bd-6c18-46d7-87e1-d3b61208905b tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Lock "b'cinder-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f-delete_volume'" acquired by "delete_volume" :: waited 0.042s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:00:36.464108 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d1b8f3bd-6c18-46d7-87e1-d3b61208905b tempest-LiveAutoBlockMigrationV225Test-1858155877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:00:36.566152 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d1b8f3bd-6c18-46d7-87e1-d3b61208905b tempest-LiveAutoBlockMigrationV225Test-1858155877 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:00:36.566941 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d1b8f3bd-6c18-46d7-87e1-d3b61208905b tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Volume volume-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:00:36.583746 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d1b8f3bd-6c18-46d7-87e1-d3b61208905b tempest-LiveAutoBlockMigrationV225Test-1858155877 None] deleting rbd volume volume-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:00:36.586166 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Created reservations ['7ceed72f-1673-43ea-991f-c05c5dd3511e', '297a1232-2252-4352-9eb6-6b3eb7fcabc1', '9815b18a-fb14-4b61-93ef-a22319e026e9', '86e8e4e6-0155-4dd3-803f-571769c239c1'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:00:36.666417 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:00:36.751540 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:00:36.803291 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:00:36.822558 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Deleted volume successfully. Jun 04 21:00:36.843476 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-61f33712-6fa1-431c-8d13-576ec01a3562 req-4b6e5937-b03d-41e9-9d26-758a7321e3e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Lock "b'cinder-153e56ad-00b6-438f-923c-903891b5c847-delete_volume'" released by "delete_volume" :: held 2.176s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:00:37.011647 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-d1b8f3bd-6c18-46d7-87e1-d3b61208905b tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Created reservations ['92d3ff09-c775-4300-b949-c466522eaedb', 'c943c3a8-a8b8-4433-8b32-c9b608d0fe22', '8fbe0556-4bba-465b-9428-a0223e1f1e86', 'be8e819f-841c-4759-870c-56ae52c273c6'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:00:37.118833 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d1b8f3bd-6c18-46d7-87e1-d3b61208905b tempest-LiveAutoBlockMigrationV225Test-1858155877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:00:37.189488 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d1b8f3bd-6c18-46d7-87e1-d3b61208905b tempest-LiveAutoBlockMigrationV225Test-1858155877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:00:37.255774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-d1b8f3bd-6c18-46d7-87e1-d3b61208905b tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:00:37.266227 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-d1b8f3bd-6c18-46d7-87e1-d3b61208905b tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Deleted volume successfully. Jun 04 21:00:37.286536 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d1b8f3bd-6c18-46d7-87e1-d3b61208905b tempest-LiveAutoBlockMigrationV225Test-1858155877 None] Lock "b'cinder-40e4e2d0-1a42-4e71-9df7-e2abd0414e4f-delete_volume'" released by "delete_volume" :: held 0.894s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:00:41.466850 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:00:41.490988 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Flow 'volume_create_manager' (a0646c2c-1a95-417c-ab6b-eed6be4bbb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:00:41.499225 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54280c7c-3e05-4b79-9a0f-ba7b45eaee56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:00:41.519414 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54280c7c-3e05-4b79-9a0f-ba7b45eaee56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-438888140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=30a9a8cf-3f14-42f9-8afc-bb0dd688c197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a6c9f3ddbf4fb48fc2d1272c612739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:00:41Z,use_quota=True,user_id='21ae179d22a140f7a6ebccaeea7932db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:00:41.528602 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63d8585-f15e-4f82-8e0a-178d322cccb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:00:41.533701 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63d8585-f15e-4f82-8e0a-178d322cccb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:00:41.539321 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec4db4e-b0bf-46ac-8142-68fa0f79e324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:00:41.543771 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec4db4e-b0bf-46ac-8142-68fa0f79e324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a9a8cf-3f14-42f9-8afc-bb0dd688c197', 'volume_name': 'volume-30a9a8cf-3f14-42f9-8afc-bb0dd688c197', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:00:41.548569 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de65a0aa-eb87-4137-825e-1a9c2d1e2ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:00:41.552558 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de65a0aa-eb87-4137-825e-1a9c2d1e2ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:00:41.557657 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb04171d-e923-431a-b9d5-a3302d84da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:00:41.559086 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Volume 30a9a8cf-3f14-42f9-8afc-bb0dd688c197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a9a8cf-3f14-42f9-8afc-bb0dd688c197', 'volume_size': 1} Jun 04 21:00:41.559551 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] creating volume 'volume-30a9a8cf-3f14-42f9-8afc-bb0dd688c197' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:00:41.560547 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:00:41.699475 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:00:41.700174 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:00:41.704683 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb04171d-e923-431a-b9d5-a3302d84da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a9a8cf-3f14-42f9-8afc-bb0dd688c197', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:00:41.710006 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ecf0d63-44cd-48cb-925c-be7a4afa7d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:00:41.722483 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Volume volume-30a9a8cf-3f14-42f9-8afc-bb0dd688c197 (30a9a8cf-3f14-42f9-8afc-bb0dd688c197): created successfully Jun 04 21:00:41.731127 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ecf0d63-44cd-48cb-925c-be7a4afa7d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:00:41.739989 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Flow 'volume_create_manager' (a0646c2c-1a95-417c-ab6b-eed6be4bbb5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:00:41.753009 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a817b3d5-41dd-4229-a06e-cead296a77c1 tempest-DeleteServersTestJSON-1275720910 None] Created volume successfully. Jun 04 21:00:43.090048 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=59,cinder:UPDATE=19,cinder:INSERT=2,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:43.093887 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-c7d04b32-3696-4d22-977d-511e736b931f req-b96f070a-85cb-4c20-94e7-b2d15ea8fad8 tempest-DeleteServersTestJSON-1275720910 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:00:44.039045 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-c7d04b32-3696-4d22-977d-511e736b931f req-b96f070a-85cb-4c20-94e7-b2d15ea8fad8 tempest-DeleteServersTestJSON-1275720910 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.945s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:00:44.040355 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-c7d04b32-3696-4d22-977d-511e736b931f req-b96f070a-85cb-4c20-94e7-b2d15ea8fad8 tempest-DeleteServersTestJSON-1275720910 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-30a9a8cf-3f14-42f9-8afc-bb0dd688c197', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '30a9a8cf-3f14-42f9-8afc-bb0dd688c197', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:00:44.113123 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-c7d04b32-3696-4d22-977d-511e736b931f req-b96f070a-85cb-4c20-94e7-b2d15ea8fad8 tempest-DeleteServersTestJSON-1275720910 None] Connection info returned from driver {'name': 'volumes/volume-30a9a8cf-3f14-42f9-8afc-bb0dd688c197', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '30a9a8cf-3f14-42f9-8afc-bb0dd688c197', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a21775ec-f856-4fdd-9cfb-92b9812a77e9'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:00:44.196813 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-c7d04b32-3696-4d22-977d-511e736b931f req-b96f070a-85cb-4c20-94e7-b2d15ea8fad8 tempest-DeleteServersTestJSON-1275720910 None] attachment_update completed successfully. Jun 04 21:00:45.336016 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:00:45.341692 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:00:45.424060 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:00:45.486672 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:00:49.921562 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-f1f5cfae-4465-4422-b89b-9c0e90283b75 req-a1446e29-9b34-4968-b662-7a680294ed7b tempest-DeleteServersTestJSON-1275720910 None] Terminate volume connection completed successfully. Jun 04 21:00:49.922267 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-f1f5cfae-4465-4422-b89b-9c0e90283b75 req-a1446e29-9b34-4968-b662-7a680294ed7b tempest-DeleteServersTestJSON-1275720910 None] Deleting attachment a21775ec-f856-4fdd-9cfb-92b9812a77e9. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:00:59.921716 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:04.496321 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=51,cinder:UPDATE=25,cinder:INSERT=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:19.689941 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-e79f02b5-f745-42d6-ad7b-6294357637a4 req-205968b4-a997-421d-86b6-c03c98b24fb2 tempest-ServerRescueNegativeTestJSON-131796696 None] Terminate volume connection completed successfully. Jun 04 21:01:19.690894 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-e79f02b5-f745-42d6-ad7b-6294357637a4 req-205968b4-a997-421d-86b6-c03c98b24fb2 tempest-ServerRescueNegativeTestJSON-131796696 None] Deleting attachment 5b7cc13b-7190-4274-8c90-e06b10c6ff2a. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:01:34.478594 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:38.009704 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:01:38.032600 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Flow 'volume_create_manager' (f8854251-c83f-4f84-b218-cbf3e35ba830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:01:38.045350 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f01eee0-ab93-4e07-9a75-174a48e60547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:38.057222 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f01eee0-ab93-4e07-9a75-174a48e60547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1640938013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e17865ce4e4d2ba7854d03668bfb78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:01:38Z,use_quota=True,user_id='890837d5b27e4471b54c1eac851e88c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:38.063091 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42810cb-7854-489a-a2fb-17a899323ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:38.071702 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42810cb-7854-489a-a2fb-17a899323ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:38.077681 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ae85c3-cee8-4da1-92cc-4affd6ef66d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:38.244291 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ae85c3-cee8-4da1-92cc-4affd6ef66d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d', 'volume_name': 'volume-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:38.254712 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295a8b84-dff4-4565-821c-ae09efd4a6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:38.259227 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295a8b84-dff4-4565-821c-ae09efd4a6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:38.272434 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9176e9dc-c8d0-47ee-9315-6b250615c49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:38.273775 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Volume 8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:01:38.274754 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Cloning 8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:01:38.295067 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:01:38.336505 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 1, 38, 300597)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:01:38.340063 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:01:38.340853 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:01:38.350059 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.055s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:01:38.352043 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:01:38.370030 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 1, 38, 365572)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:01:38.371361 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:01:38.372261 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:01:38.387652 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:01:38.525835 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] creating snapshot='volume-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:01:39.472404 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d.clone_snap' to 'volume-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:01:39.717031 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:01:39.718767 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:01:39.719057 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:01:39.760403 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:01:39.761983 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Marking volume 8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:01:39.777043 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:01:39.777940 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Creating volume glance metadata for volume 8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:01:39.894552 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9176e9dc-c8d0-47ee-9315-6b250615c49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:39.904264 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812511c7-068f-4c42-885b-3848ed26cb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:39.919055 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3311702b-55a5-4351-9e09-0995d54564fa tempest-ServerRescueNegativeTestJSON-131796696 None] Lock "b'cinder-37cf4b6a-6b9d-4adb-8221-172f88294ef6-delete_volume'" acquired by "delete_volume" :: waited 0.042s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:01:39.925037 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Volume volume-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d (8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d): created successfully Jun 04 21:01:39.940918 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812511c7-068f-4c42-885b-3848ed26cb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:39.953305 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Flow 'volume_create_manager' (f8854251-c83f-4f84-b218-cbf3e35ba830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:01:39.974915 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ec870b1f-7bd7-46f2-9a81-f1f2b4b7ed31 tempest-TaggedBootDevicesTest-1959467912 None] Created volume successfully. Jun 04 21:01:40.014289 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3311702b-55a5-4351-9e09-0995d54564fa tempest-ServerRescueNegativeTestJSON-131796696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:01:40.124197 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3311702b-55a5-4351-9e09-0995d54564fa tempest-ServerRescueNegativeTestJSON-131796696 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:01:40.124826 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3311702b-55a5-4351-9e09-0995d54564fa tempest-ServerRescueNegativeTestJSON-131796696 None] Volume volume-37cf4b6a-6b9d-4adb-8221-172f88294ef6 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:01:40.135781 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3311702b-55a5-4351-9e09-0995d54564fa tempest-ServerRescueNegativeTestJSON-131796696 None] deleting rbd volume volume-37cf4b6a-6b9d-4adb-8221-172f88294ef6 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:01:40.683029 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-3311702b-55a5-4351-9e09-0995d54564fa tempest-ServerRescueNegativeTestJSON-131796696 None] Created reservations ['e7fe4305-e697-4cf5-bb13-ee2f0fb3bc90', '8cde8913-8072-4ee8-9366-6deed9ec8e8c', 'abb7077c-ed4f-447c-94ca-8e1a1d1e1e75', '0491768b-e336-47e5-81df-8cd7c6db49eb'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:01:40.781615 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:01:40.842492 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Flow 'volume_create_manager' (68f6bdf8-241d-40b8-a25f-8c2fc7086067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:01:40.850673 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a5a759-f86d-4a1a-85fb-e2be2a59c22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:40.889982 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3311702b-55a5-4351-9e09-0995d54564fa tempest-ServerRescueNegativeTestJSON-131796696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:01:40.949477 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3311702b-55a5-4351-9e09-0995d54564fa tempest-ServerRescueNegativeTestJSON-131796696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:01:41.017361 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-3311702b-55a5-4351-9e09-0995d54564fa tempest-ServerRescueNegativeTestJSON-131796696 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:01:41.029200 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a5a759-f86d-4a1a-85fb-e2be2a59c22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-221418809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6b1fd212-16d5-4e38-9bf7-191bb6888943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e17865ce4e4d2ba7854d03668bfb78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:01:41Z,use_quota=True,user_id='890837d5b27e4471b54c1eac851e88c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:41.037561 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02330ad-12d5-4db2-bf20-b95cb440b9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:41.044752 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02330ad-12d5-4db2-bf20-b95cb440b9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:41.051376 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab15a4c-7dc0-4967-94e6-c29914b4f1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:41.074679 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab15a4c-7dc0-4967-94e6-c29914b4f1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1fd212-16d5-4e38-9bf7-191bb6888943', 'volume_name': 'volume-6b1fd212-16d5-4e38-9bf7-191bb6888943', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:41.088848 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdeba86c-916a-4c3e-9379-a04aecacaa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:41.098824 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdeba86c-916a-4c3e-9379-a04aecacaa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:41.113474 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf8165a-63d1-4618-bd71-7ac5c1ac1576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:41.115226 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Volume 6b1fd212-16d5-4e38-9bf7-191bb6888943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1fd212-16d5-4e38-9bf7-191bb6888943', 'volume_size': 1} Jun 04 21:01:41.116911 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] creating volume 'volume-6b1fd212-16d5-4e38-9bf7-191bb6888943' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:01:41.119577 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:01:41.188153 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3311702b-55a5-4351-9e09-0995d54564fa tempest-ServerRescueNegativeTestJSON-131796696 None] Deleted volume successfully. Jun 04 21:01:41.228593 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-b4ad7d74-387c-4dd8-91c2-4ad2c046a343 tempest-ServerRescueNegativeTestJSON-131796696 None] Lock "b'cinder-57211fbb-e5c5-4cac-abe8-b47d9d3eac1e-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:01:41.238493 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3311702b-55a5-4351-9e09-0995d54564fa tempest-ServerRescueNegativeTestJSON-131796696 None] Lock "b'cinder-37cf4b6a-6b9d-4adb-8221-172f88294ef6-delete_volume'" released by "delete_volume" :: held 1.320s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:01:41.290726 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:01:41.291427 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:01:41.295200 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf8165a-63d1-4618-bd71-7ac5c1ac1576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1fd212-16d5-4e38-9bf7-191bb6888943', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:41.309425 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a951e835-39fe-479f-ba93-b78d7e9061f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:41.334319 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b4ad7d74-387c-4dd8-91c2-4ad2c046a343 tempest-ServerRescueNegativeTestJSON-131796696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:01:41.455890 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b4ad7d74-387c-4dd8-91c2-4ad2c046a343 tempest-ServerRescueNegativeTestJSON-131796696 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:01:41.456469 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b4ad7d74-387c-4dd8-91c2-4ad2c046a343 tempest-ServerRescueNegativeTestJSON-131796696 None] Volume volume-57211fbb-e5c5-4cac-abe8-b47d9d3eac1e is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:01:41.466049 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b4ad7d74-387c-4dd8-91c2-4ad2c046a343 tempest-ServerRescueNegativeTestJSON-131796696 None] deleting rbd volume volume-57211fbb-e5c5-4cac-abe8-b47d9d3eac1e {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:01:41.468807 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Volume volume-6b1fd212-16d5-4e38-9bf7-191bb6888943 (6b1fd212-16d5-4e38-9bf7-191bb6888943): created successfully Jun 04 21:01:41.473456 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a951e835-39fe-479f-ba93-b78d7e9061f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:41.485931 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Flow 'volume_create_manager' (68f6bdf8-241d-40b8-a25f-8c2fc7086067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:01:41.515702 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ae3ae97d-549b-48ba-acce-055f59450c74 tempest-TaggedBootDevicesTest-1959467912 None] Created volume successfully. Jun 04 21:01:41.865218 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-b4ad7d74-387c-4dd8-91c2-4ad2c046a343 tempest-ServerRescueNegativeTestJSON-131796696 None] Created reservations ['720d2351-5348-4692-b819-ff45acc6d8b6', '6f55411b-6c91-4602-9e00-6b7a937a8fb2', 'd8ec8b31-6731-4d97-8eb1-3c171cac7f8f', '623b1fe5-483a-4fae-897a-b5125385ffae'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:01:41.956751 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b4ad7d74-387c-4dd8-91c2-4ad2c046a343 tempest-ServerRescueNegativeTestJSON-131796696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:01:42.017260 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b4ad7d74-387c-4dd8-91c2-4ad2c046a343 tempest-ServerRescueNegativeTestJSON-131796696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:01:42.120121 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-b4ad7d74-387c-4dd8-91c2-4ad2c046a343 tempest-ServerRescueNegativeTestJSON-131796696 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:01:42.126740 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b4ad7d74-387c-4dd8-91c2-4ad2c046a343 tempest-ServerRescueNegativeTestJSON-131796696 None] Deleted volume successfully. Jun 04 21:01:42.146963 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-b4ad7d74-387c-4dd8-91c2-4ad2c046a343 tempest-ServerRescueNegativeTestJSON-131796696 None] Lock "b'cinder-57211fbb-e5c5-4cac-abe8-b47d9d3eac1e-delete_volume'" released by "delete_volume" :: held 0.918s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:01:42.247774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:01:42.275051 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Flow 'volume_create_manager' (1ea1f888-985f-471a-b6ad-608696415627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:01:42.282611 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbb23fd-3819-4bd5-947e-b5a2b13c11ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:42.313231 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbb23fd-3819-4bd5-947e-b5a2b13c11ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-756229974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f599bf47-2ed2-4605-a2b8-f112ebbf3bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e17865ce4e4d2ba7854d03668bfb78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:01:42Z,use_quota=True,user_id='890837d5b27e4471b54c1eac851e88c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:42.319609 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a4c7b8-c4a7-40b7-9997-0e4088dd9cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:42.326239 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a4c7b8-c4a7-40b7-9997-0e4088dd9cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:42.336240 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf499788-9f30-4b32-9b74-b35f3d576d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:42.341463 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf499788-9f30-4b32-9b74-b35f3d576d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f599bf47-2ed2-4605-a2b8-f112ebbf3bca', 'volume_name': 'volume-f599bf47-2ed2-4605-a2b8-f112ebbf3bca', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:42.348164 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44146c97-9750-4c33-991d-05c29877cff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:42.353703 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44146c97-9750-4c33-991d-05c29877cff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:42.359744 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699758ec-49ae-4459-80b5-3c3967312a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:42.361317 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Volume f599bf47-2ed2-4605-a2b8-f112ebbf3bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f599bf47-2ed2-4605-a2b8-f112ebbf3bca', 'volume_size': 1} Jun 04 21:01:42.361913 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] creating volume 'volume-f599bf47-2ed2-4605-a2b8-f112ebbf3bca' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:01:42.363176 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:01:42.525690 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:01:42.526323 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:01:42.530493 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699758ec-49ae-4459-80b5-3c3967312a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f599bf47-2ed2-4605-a2b8-f112ebbf3bca', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:42.536657 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2612e1b0-d0a0-45b0-86b2-719f628e658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:01:42.552440 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Volume volume-f599bf47-2ed2-4605-a2b8-f112ebbf3bca (f599bf47-2ed2-4605-a2b8-f112ebbf3bca): created successfully Jun 04 21:01:42.558829 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2612e1b0-d0a0-45b0-86b2-719f628e658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:01:42.566819 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Flow 'volume_create_manager' (1ea1f888-985f-471a-b6ad-608696415627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:01:42.581150 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-87aa0050-ce08-402b-8251-0c588c830e4e tempest-TaggedBootDevicesTest-1959467912 None] Created volume successfully. Jun 04 21:01:45.333415 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:01:45.334613 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:01:45.402636 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:01:45.464767 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:01:54.476324 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=48,cinder:UPDATE=31,cinder:DELETE=5,cinder:INSERT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:11.149022 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=60,cinder:UPDATE=16,cinder:INSERT=18 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:11.177830 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:02:11.212212 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Flow 'volume_create_manager' (1024d56e-3fff-4b77-9e4a-98b80c6abe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:02:11.221779 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db53b1c-6be1-4b5b-80a1-e1b84bf79b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:11.245359 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db53b1c-6be1-4b5b-80a1-e1b84bf79b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-655805422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=486d9d16-1708-4bd5-a2d7-9c4c4c816bf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='139f5d3f3de240729676f4ddd8be570b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:02:11Z,use_quota=True,user_id='9b880344bb5846c299d5b6d653f44d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:11.253050 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa216b6-9477-4978-847a-fd371d8aebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:11.259378 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa216b6-9477-4978-847a-fd371d8aebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:11.265906 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f90edd-6061-46d2-8c5d-e0c72168daf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:11.271936 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f90edd-6061-46d2-8c5d-e0c72168daf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486d9d16-1708-4bd5-a2d7-9c4c4c816bf5', 'volume_name': 'volume-486d9d16-1708-4bd5-a2d7-9c4c4c816bf5', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:11.279569 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf49f772-de4f-45dc-b0d2-2e52c80ff013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:11.293313 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf49f772-de4f-45dc-b0d2-2e52c80ff013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:11.298199 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d64bd5-a0f1-463c-801b-cab2b8911413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:11.306796 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Volume 486d9d16-1708-4bd5-a2d7-9c4c4c816bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486d9d16-1708-4bd5-a2d7-9c4c4c816bf5', 'volume_size': 1} Jun 04 21:02:11.307454 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] creating volume 'volume-486d9d16-1708-4bd5-a2d7-9c4c4c816bf5' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:02:11.308690 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:11.409646 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:02:11.410017 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:02:11.413836 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d64bd5-a0f1-463c-801b-cab2b8911413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486d9d16-1708-4bd5-a2d7-9c4c4c816bf5', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:11.420184 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518f6180-abfd-45cc-a557-c0de3765eb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:11.452933 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Volume volume-486d9d16-1708-4bd5-a2d7-9c4c4c816bf5 (486d9d16-1708-4bd5-a2d7-9c4c4c816bf5): created successfully Jun 04 21:02:11.466705 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518f6180-abfd-45cc-a557-c0de3765eb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:11.485246 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Flow 'volume_create_manager' (1024d56e-3fff-4b77-9e4a-98b80c6abe99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:02:11.507295 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-5dddd954-fab4-457b-986c-ec93418dc16b tempest-VolumesTestJSON-1112445710 None] Created volume successfully. Jun 04 21:02:13.112554 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:02:13.138585 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Flow 'volume_create_manager' (c4f527fd-fdfe-4eb3-bc69-10b62a689545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:02:13.148771 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0685cf4-90d2-4ffa-8bf1-b05f4182338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:13.179898 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0685cf4-90d2-4ffa-8bf1-b05f4182338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2056908601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=df11e662-aeda-4b26-b7a4-afbbfa1f55ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='139f5d3f3de240729676f4ddd8be570b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:02:13Z,use_quota=True,user_id='9b880344bb5846c299d5b6d653f44d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:13.186045 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c732584-522f-4e4d-819e-f60a23907381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:13.190864 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c732584-522f-4e4d-819e-f60a23907381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:13.200753 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e861f8-99e8-4eea-8d17-baaa7693117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:13.206134 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e861f8-99e8-4eea-8d17-baaa7693117d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df11e662-aeda-4b26-b7a4-afbbfa1f55ab', 'volume_name': 'volume-df11e662-aeda-4b26-b7a4-afbbfa1f55ab', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:13.214542 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76204f81-43ac-4389-a78f-3c54703b4be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:13.219650 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76204f81-43ac-4389-a78f-3c54703b4be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:13.225208 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f40e85-41e8-4d7c-9c68-e7f967cab810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:13.226623 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Volume df11e662-aeda-4b26-b7a4-afbbfa1f55ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df11e662-aeda-4b26-b7a4-afbbfa1f55ab', 'volume_size': 1} Jun 04 21:02:13.227200 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] creating volume 'volume-df11e662-aeda-4b26-b7a4-afbbfa1f55ab' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:02:13.228474 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:13.355956 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:02:13.356323 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:02:13.369203 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f40e85-41e8-4d7c-9c68-e7f967cab810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df11e662-aeda-4b26-b7a4-afbbfa1f55ab', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:13.380177 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54dc703-526f-4b4c-874e-762161949921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:13.395586 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Volume volume-df11e662-aeda-4b26-b7a4-afbbfa1f55ab (df11e662-aeda-4b26-b7a4-afbbfa1f55ab): created successfully Jun 04 21:02:13.401655 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54dc703-526f-4b4c-874e-762161949921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:13.408736 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Flow 'volume_create_manager' (c4f527fd-fdfe-4eb3-bc69-10b62a689545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:02:13.439152 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-55ecea0a-c3f4-48f9-83b3-b3e5d9c8dd3b tempest-TaggedBootDevicesTest-1959467912 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:02:13.470080 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8d53ed3c-ec55-4423-9c6f-2af74be06863 tempest-VolumesTestJSON-1112445710 None] Created volume successfully. Jun 04 21:02:14.582725 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-55ecea0a-c3f4-48f9-83b3-b3e5d9c8dd3b tempest-TaggedBootDevicesTest-1959467912 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.144s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:02:14.583600 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-55ecea0a-c3f4-48f9-83b3-b3e5d9c8dd3b tempest-TaggedBootDevicesTest-1959467912 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:02:14.621027 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-55ecea0a-c3f4-48f9-83b3-b3e5d9c8dd3b tempest-TaggedBootDevicesTest-1959467912 None] Connection info returned from driver {'name': 'volumes/volume-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '31020dbd-bd97-4bbf-b0d0-f2f1e9841e30'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:02:14.690798 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-55ecea0a-c3f4-48f9-83b3-b3e5d9c8dd3b tempest-TaggedBootDevicesTest-1959467912 None] attachment_update completed successfully. Jun 04 21:02:15.182833 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-bc945b6b-6f8d-40f0-9a7e-ed09852f2b52 tempest-TaggedBootDevicesTest-1959467912 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:02:15.859156 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:02:15.895570 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Flow 'volume_create_manager' (5ca3baa1-8757-4543-9ae1-92df0bef82ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:02:15.906807 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6230cf-3d38-47fd-9663-2f0b5ac47f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:15.963273 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6230cf-3d38-47fd-9663-2f0b5ac47f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-602407019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9de5126a-5677-4cda-ad59-0adf514e7b31,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='139f5d3f3de240729676f4ddd8be570b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:02:16Z,use_quota=True,user_id='9b880344bb5846c299d5b6d653f44d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:15.973561 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0776f9-4fae-4d56-a7d2-ac8f33f75342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:15.982927 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0776f9-4fae-4d56-a7d2-ac8f33f75342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:15.992458 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5f465b-a746-4765-96bc-e28a4a471496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:16.002636 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5f465b-a746-4765-96bc-e28a4a471496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de5126a-5677-4cda-ad59-0adf514e7b31', 'volume_name': 'volume-9de5126a-5677-4cda-ad59-0adf514e7b31', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:16.010291 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4effc9d-df64-4cbd-8b68-c3e55417cdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:16.016236 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4effc9d-df64-4cbd-8b68-c3e55417cdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:16.027564 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55988012-479c-4b82-b615-93e7df558f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:16.029740 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Volume 9de5126a-5677-4cda-ad59-0adf514e7b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de5126a-5677-4cda-ad59-0adf514e7b31', 'volume_size': 1} Jun 04 21:02:16.030914 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] creating volume 'volume-9de5126a-5677-4cda-ad59-0adf514e7b31' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:02:16.031971 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:16.162118 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:02:16.162836 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:02:16.168754 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55988012-479c-4b82-b615-93e7df558f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de5126a-5677-4cda-ad59-0adf514e7b31', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:16.173695 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73ecc43-11ac-49be-b2d0-fbe640815582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:02:16.195496 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Volume volume-9de5126a-5677-4cda-ad59-0adf514e7b31 (9de5126a-5677-4cda-ad59-0adf514e7b31): created successfully Jun 04 21:02:16.200967 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73ecc43-11ac-49be-b2d0-fbe640815582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:02:16.221373 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Flow 'volume_create_manager' (5ca3baa1-8757-4543-9ae1-92df0bef82ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:02:16.245891 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-6989d08e-c71b-4e35-aa5a-b7a497f6d2c0 tempest-VolumesTestJSON-1112445710 None] Created volume successfully. Jun 04 21:02:16.250878 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-bc945b6b-6f8d-40f0-9a7e-ed09852f2b52 tempest-TaggedBootDevicesTest-1959467912 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.068s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:02:16.252447 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-bc945b6b-6f8d-40f0-9a7e-ed09852f2b52 tempest-TaggedBootDevicesTest-1959467912 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6b1fd212-16d5-4e38-9bf7-191bb6888943', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '6b1fd212-16d5-4e38-9bf7-191bb6888943', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:02:16.288057 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-bc945b6b-6f8d-40f0-9a7e-ed09852f2b52 tempest-TaggedBootDevicesTest-1959467912 None] Connection info returned from driver {'name': 'volumes/volume-6b1fd212-16d5-4e38-9bf7-191bb6888943', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6b1fd212-16d5-4e38-9bf7-191bb6888943', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '796254de-5937-410d-a1ea-641ab6f51ac8'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:02:16.381022 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-bc945b6b-6f8d-40f0-9a7e-ed09852f2b52 tempest-TaggedBootDevicesTest-1959467912 None] attachment_update completed successfully. Jun 04 21:02:16.923275 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-a7d5bf8b-ddd2-4fde-abf4-0341eb9f2d81 tempest-TaggedBootDevicesTest-1959467912 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:02:17.644743 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-a7d5bf8b-ddd2-4fde-abf4-0341eb9f2d81 tempest-TaggedBootDevicesTest-1959467912 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.721s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:02:17.648047 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-a7d5bf8b-ddd2-4fde-abf4-0341eb9f2d81 tempest-TaggedBootDevicesTest-1959467912 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f599bf47-2ed2-4605-a2b8-f112ebbf3bca', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'f599bf47-2ed2-4605-a2b8-f112ebbf3bca', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:02:17.706469 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-a7d5bf8b-ddd2-4fde-abf4-0341eb9f2d81 tempest-TaggedBootDevicesTest-1959467912 None] Connection info returned from driver {'name': 'volumes/volume-f599bf47-2ed2-4605-a2b8-f112ebbf3bca', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f599bf47-2ed2-4605-a2b8-f112ebbf3bca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9e5e0797-590e-4a9d-8449-a92e6b9f6d38'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:02:17.777170 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-dd092e19-5629-4cf4-ab32-888d958f0aa5 req-a7d5bf8b-ddd2-4fde-abf4-0341eb9f2d81 tempest-TaggedBootDevicesTest-1959467912 None] attachment_update completed successfully. Jun 04 21:02:26.950476 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-240d6391-e291-4208-80d7-af3d2c29a2b2 tempest-VolumesTestJSON-1112445710 None] Lock "b'cinder-9de5126a-5677-4cda-ad59-0adf514e7b31-delete_volume'" acquired by "delete_volume" :: waited 0.050s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:02:26.983465 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=13,cinder:SELECT=52,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:27.051111 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-240d6391-e291-4208-80d7-af3d2c29a2b2 tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:27.152824 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-240d6391-e291-4208-80d7-af3d2c29a2b2 tempest-VolumesTestJSON-1112445710 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:02:27.153275 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-240d6391-e291-4208-80d7-af3d2c29a2b2 tempest-VolumesTestJSON-1112445710 None] Volume volume-9de5126a-5677-4cda-ad59-0adf514e7b31 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:02:27.166424 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-240d6391-e291-4208-80d7-af3d2c29a2b2 tempest-VolumesTestJSON-1112445710 None] deleting rbd volume volume-9de5126a-5677-4cda-ad59-0adf514e7b31 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:02:27.636986 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-240d6391-e291-4208-80d7-af3d2c29a2b2 tempest-VolumesTestJSON-1112445710 None] Created reservations ['558e390f-1b83-4c50-904a-c9d11847326c', '197de0c3-b64c-4f91-a7bd-30845e75760a', '079c1c90-6048-433c-ba35-dc8979fc0e78', '294e8b4f-f1a8-4f6e-a2ea-2420ac2d068b'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:02:27.727560 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-240d6391-e291-4208-80d7-af3d2c29a2b2 tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:27.806764 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-240d6391-e291-4208-80d7-af3d2c29a2b2 tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:27.842955 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-240d6391-e291-4208-80d7-af3d2c29a2b2 tempest-VolumesTestJSON-1112445710 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:02:27.847761 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-240d6391-e291-4208-80d7-af3d2c29a2b2 tempest-VolumesTestJSON-1112445710 None] Deleted volume successfully. Jun 04 21:02:27.869024 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-240d6391-e291-4208-80d7-af3d2c29a2b2 tempest-VolumesTestJSON-1112445710 None] Lock "b'cinder-9de5126a-5677-4cda-ad59-0adf514e7b31-delete_volume'" released by "delete_volume" :: held 0.919s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:02:28.191849 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-221be416-079d-4aea-ab5e-a08be0cad517 tempest-VolumesTestJSON-1112445710 None] Lock "b'cinder-df11e662-aeda-4b26-b7a4-afbbfa1f55ab-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:02:28.283094 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-221be416-079d-4aea-ab5e-a08be0cad517 tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:28.340560 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-221be416-079d-4aea-ab5e-a08be0cad517 tempest-VolumesTestJSON-1112445710 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:02:28.341679 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-221be416-079d-4aea-ab5e-a08be0cad517 tempest-VolumesTestJSON-1112445710 None] Volume volume-df11e662-aeda-4b26-b7a4-afbbfa1f55ab is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:02:28.353122 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-221be416-079d-4aea-ab5e-a08be0cad517 tempest-VolumesTestJSON-1112445710 None] deleting rbd volume volume-df11e662-aeda-4b26-b7a4-afbbfa1f55ab {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:02:28.822716 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-221be416-079d-4aea-ab5e-a08be0cad517 tempest-VolumesTestJSON-1112445710 None] Created reservations ['ac84e27c-1429-4361-8527-4b8bfd88b6fd', '763be6be-969e-44d6-bdc0-f7e6ec0c172f', '513ecd02-df73-412b-8618-53e3623b5ca9', '6077c998-20d9-47d6-befb-5e866db63e05'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:02:28.932935 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-221be416-079d-4aea-ab5e-a08be0cad517 tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:29.002240 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-221be416-079d-4aea-ab5e-a08be0cad517 tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:29.065318 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-221be416-079d-4aea-ab5e-a08be0cad517 tempest-VolumesTestJSON-1112445710 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:02:29.069831 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-221be416-079d-4aea-ab5e-a08be0cad517 tempest-VolumesTestJSON-1112445710 None] Deleted volume successfully. Jun 04 21:02:29.085468 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-221be416-079d-4aea-ab5e-a08be0cad517 tempest-VolumesTestJSON-1112445710 None] Lock "b'cinder-df11e662-aeda-4b26-b7a4-afbbfa1f55ab-delete_volume'" released by "delete_volume" :: held 0.895s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:02:29.485692 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-fc74e957-4de1-4f3b-b612-532767d7111d tempest-VolumesTestJSON-1112445710 None] Lock "b'cinder-486d9d16-1708-4bd5-a2d7-9c4c4c816bf5-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:02:29.555049 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fc74e957-4de1-4f3b-b612-532767d7111d tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:29.644885 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fc74e957-4de1-4f3b-b612-532767d7111d tempest-VolumesTestJSON-1112445710 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:02:29.645636 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fc74e957-4de1-4f3b-b612-532767d7111d tempest-VolumesTestJSON-1112445710 None] Volume volume-486d9d16-1708-4bd5-a2d7-9c4c4c816bf5 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:02:29.656313 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fc74e957-4de1-4f3b-b612-532767d7111d tempest-VolumesTestJSON-1112445710 None] deleting rbd volume volume-486d9d16-1708-4bd5-a2d7-9c4c4c816bf5 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:02:30.016168 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=74,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:30.117983 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-fc74e957-4de1-4f3b-b612-532767d7111d tempest-VolumesTestJSON-1112445710 None] Created reservations ['4a99da2d-f085-444e-a441-0a1381117cbe', 'c2a06540-cd0e-4692-b64b-fe15ae402d65', '56d6fdb8-142c-451b-8114-58aec2178a55', 'f3dea786-89c3-4658-970a-6abdc812aab9'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:02:30.254092 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fc74e957-4de1-4f3b-b612-532767d7111d tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:30.321835 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fc74e957-4de1-4f3b-b612-532767d7111d tempest-VolumesTestJSON-1112445710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:30.391917 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-fc74e957-4de1-4f3b-b612-532767d7111d tempest-VolumesTestJSON-1112445710 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:02:30.397593 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-fc74e957-4de1-4f3b-b612-532767d7111d tempest-VolumesTestJSON-1112445710 None] Deleted volume successfully. Jun 04 21:02:30.415318 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-fc74e957-4de1-4f3b-b612-532767d7111d tempest-VolumesTestJSON-1112445710 None] Lock "b'cinder-486d9d16-1708-4bd5-a2d7-9c4c4c816bf5-delete_volume'" released by "delete_volume" :: held 0.930s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:02:40.404394 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:INSERT=2,cinder:SELECT=5,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:45.330898 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:02:45.331697 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:45.432025 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:02:45.537474 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:02:54.484173 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=37,cinder:INSERT=6,cinder:UPDATE=31,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:07.629026 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0e37a044-66f4-4abe-af3f-683fcab116ae tempest-ServersNegativeTestJSON-1931291149 None] Lock "b'cinder-30a79c1e-eb28-4879-87bc-0d6a7f76e1eb-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:03:07.688882 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0e37a044-66f4-4abe-af3f-683fcab116ae tempest-ServersNegativeTestJSON-1931291149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:03:07.785256 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0e37a044-66f4-4abe-af3f-683fcab116ae tempest-ServersNegativeTestJSON-1931291149 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:03:07.786806 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0e37a044-66f4-4abe-af3f-683fcab116ae tempest-ServersNegativeTestJSON-1931291149 None] Volume volume-30a79c1e-eb28-4879-87bc-0d6a7f76e1eb is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:03:07.797378 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0e37a044-66f4-4abe-af3f-683fcab116ae tempest-ServersNegativeTestJSON-1931291149 None] deleting rbd volume volume-30a79c1e-eb28-4879-87bc-0d6a7f76e1eb {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:03:08.382332 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-0e37a044-66f4-4abe-af3f-683fcab116ae tempest-ServersNegativeTestJSON-1931291149 None] Created reservations ['ee1f51bd-1b45-4865-ba91-ce3fceb8c49d', '57ab792e-dd64-4d1e-a48f-441f9a6a0648', '41f4cf86-cb12-4108-9b64-5b0fb6e68b53', '52cfd739-a1eb-401c-bbf2-c8212705de8d'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:03:08.545229 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0e37a044-66f4-4abe-af3f-683fcab116ae tempest-ServersNegativeTestJSON-1931291149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:03:08.662696 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0e37a044-66f4-4abe-af3f-683fcab116ae tempest-ServersNegativeTestJSON-1931291149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:03:08.757304 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0e37a044-66f4-4abe-af3f-683fcab116ae tempest-ServersNegativeTestJSON-1931291149 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:03:08.763741 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0e37a044-66f4-4abe-af3f-683fcab116ae tempest-ServersNegativeTestJSON-1931291149 None] Deleted volume successfully. Jun 04 21:03:08.782787 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0e37a044-66f4-4abe-af3f-683fcab116ae tempest-ServersNegativeTestJSON-1931291149 None] Lock "b'cinder-30a79c1e-eb28-4879-87bc-0d6a7f76e1eb-delete_volume'" released by "delete_volume" :: held 1.155s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:03:08.935792 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-9490d94b-c400-49d7-b60e-dbd36cd88cce tempest-ServersNegativeTestJSON-1931291149 None] Lock "b'cinder-ac96704a-67df-48a9-a9a6-4111f08c7fdb-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:03:09.036011 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9490d94b-c400-49d7-b60e-dbd36cd88cce tempest-ServersNegativeTestJSON-1931291149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:03:09.152605 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9490d94b-c400-49d7-b60e-dbd36cd88cce tempest-ServersNegativeTestJSON-1931291149 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:03:09.153117 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9490d94b-c400-49d7-b60e-dbd36cd88cce tempest-ServersNegativeTestJSON-1931291149 None] Volume volume-ac96704a-67df-48a9-a9a6-4111f08c7fdb is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:03:09.163109 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9490d94b-c400-49d7-b60e-dbd36cd88cce tempest-ServersNegativeTestJSON-1931291149 None] deleting rbd volume volume-ac96704a-67df-48a9-a9a6-4111f08c7fdb {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:03:09.725053 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-9490d94b-c400-49d7-b60e-dbd36cd88cce tempest-ServersNegativeTestJSON-1931291149 None] Created reservations ['18cfcfd2-20b6-4280-abc2-7152351361c4', 'de3d1819-65aa-4875-9295-ff5157cb3be8', 'd729fff7-95f5-4d67-926c-30783361bd72', 'a07c7e51-2a07-4587-b829-6e33b1ee28e0'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:03:09.882714 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9490d94b-c400-49d7-b60e-dbd36cd88cce tempest-ServersNegativeTestJSON-1931291149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:03:09.954032 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9490d94b-c400-49d7-b60e-dbd36cd88cce tempest-ServersNegativeTestJSON-1931291149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:03:10.049195 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-9490d94b-c400-49d7-b60e-dbd36cd88cce tempest-ServersNegativeTestJSON-1931291149 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:03:10.055268 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9490d94b-c400-49d7-b60e-dbd36cd88cce tempest-ServersNegativeTestJSON-1931291149 None] Deleted volume successfully. Jun 04 21:03:10.076795 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-9490d94b-c400-49d7-b60e-dbd36cd88cce tempest-ServersNegativeTestJSON-1931291149 None] Lock "b'cinder-ac96704a-67df-48a9-a9a6-4111f08c7fdb-delete_volume'" released by "delete_volume" :: held 1.141s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:03:14.490968 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=33,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:34.485809 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=28,cinder:UPDATE=22,cinder:INSERT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:45.333179 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:03:45.333984 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:03:45.462549 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:03:45.499695 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:03:54.491897 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:14.494023 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:34.497839 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:45.336861 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:04:45.337515 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:04:45.447254 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:04:45.478153 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:04:54.500156 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:09.874838 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-7878c2d4-4a11-4fae-814a-49875dc11289 tempest-DeleteServersTestJSON-1275720910 None] Lock "b'cinder-30a9a8cf-3f14-42f9-8afc-bb0dd688c197-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:05:09.934160 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:09.963707 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7878c2d4-4a11-4fae-814a-49875dc11289 tempest-DeleteServersTestJSON-1275720910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:05:10.094204 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7878c2d4-4a11-4fae-814a-49875dc11289 tempest-DeleteServersTestJSON-1275720910 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:05:10.094636 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7878c2d4-4a11-4fae-814a-49875dc11289 tempest-DeleteServersTestJSON-1275720910 None] Volume volume-30a9a8cf-3f14-42f9-8afc-bb0dd688c197 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:05:10.112412 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7878c2d4-4a11-4fae-814a-49875dc11289 tempest-DeleteServersTestJSON-1275720910 None] deleting rbd volume volume-30a9a8cf-3f14-42f9-8afc-bb0dd688c197 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:05:10.664841 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-7878c2d4-4a11-4fae-814a-49875dc11289 tempest-DeleteServersTestJSON-1275720910 None] Created reservations ['1426a798-c596-4bd8-84c7-0e8109a0dbb5', 'd21ad553-3a77-4753-b97e-859881f1872a', '660c2b1d-f5e2-4613-a3ea-1a73be4722bf', '24a8d972-3d3a-4ed1-a3a6-0c77cff84274'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:05:10.737721 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7878c2d4-4a11-4fae-814a-49875dc11289 tempest-DeleteServersTestJSON-1275720910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:05:10.818663 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7878c2d4-4a11-4fae-814a-49875dc11289 tempest-DeleteServersTestJSON-1275720910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:05:10.891165 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-7878c2d4-4a11-4fae-814a-49875dc11289 tempest-DeleteServersTestJSON-1275720910 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:05:10.897238 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-7878c2d4-4a11-4fae-814a-49875dc11289 tempest-DeleteServersTestJSON-1275720910 None] Deleted volume successfully. Jun 04 21:05:10.918021 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-7878c2d4-4a11-4fae-814a-49875dc11289 tempest-DeleteServersTestJSON-1275720910 None] Lock "b'cinder-30a9a8cf-3f14-42f9-8afc-bb0dd688c197-delete_volume'" released by "delete_volume" :: held 1.043s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:05:24.518636 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=10,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:24.539689 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6,cinder:INSERT=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:25.084817 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:05:25.117684 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Flow 'volume_create_manager' (b038550b-a8af-47d4-bc3a-56a3f190b9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:05:25.127655 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f96e4f3-9131-42d6-863a-97e40d18b634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:25.155184 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f96e4f3-9131-42d6-863a-97e40d18b634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-480086952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1c27712d-6df1-47b7-b0cf-47c6b5bea42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee106eb4506843ffa58a26f486d2e0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:05:25Z,use_quota=True,user_id='1e858abe021e480686f6458e5b27ad24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:25.165325 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce62f920-e681-4577-9982-a55ca8af0ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:25.179054 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce62f920-e681-4577-9982-a55ca8af0ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:25.192020 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0108d74a-f32d-4468-a89b-fa00faeda5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:25.349382 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0108d74a-f32d-4468-a89b-fa00faeda5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c27712d-6df1-47b7-b0cf-47c6b5bea42a', 'volume_name': 'volume-1c27712d-6df1-47b7-b0cf-47c6b5bea42a', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:25.354268 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a60eb5d-eb5e-42be-ad8d-cdcf4f05262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:25.386098 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a60eb5d-eb5e-42be-ad8d-cdcf4f05262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:25.402053 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d791ea39-1dae-4dca-9b33-f59f253a9d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:25.403943 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Volume 1c27712d-6df1-47b7-b0cf-47c6b5bea42a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c27712d-6df1-47b7-b0cf-47c6b5bea42a', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:05:25.410047 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Cloning 1c27712d-6df1-47b7-b0cf-47c6b5bea42a from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:05:25.442287 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:05:25.467048 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 5, 25, 451809)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:05:25.468714 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:05:25.470035 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:05:25.501269 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.061s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:05:25.503542 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:05:25.542549 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 5, 25, 527862)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:05:25.543267 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:05:25.543353 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:05:25.593698 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:05:25.737263 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] creating snapshot='volume-1c27712d-6df1-47b7-b0cf-47c6b5bea42a.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:05:26.477737 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-1c27712d-6df1-47b7-b0cf-47c6b5bea42a.clone_snap' to 'volume-1c27712d-6df1-47b7-b0cf-47c6b5bea42a' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:05:26.730666 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:05:26.734153 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:05:26.734734 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:05:26.776137 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:05:26.777103 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Marking volume 1c27712d-6df1-47b7-b0cf-47c6b5bea42a as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:05:26.813637 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 1c27712d-6df1-47b7-b0cf-47c6b5bea42a. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:05:26.814718 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Creating volume glance metadata for volume 1c27712d-6df1-47b7-b0cf-47c6b5bea42a backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:05:26.961092 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d791ea39-1dae-4dca-9b33-f59f253a9d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c27712d-6df1-47b7-b0cf-47c6b5bea42a', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:26.975036 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb014100-f2d2-4f19-bbab-2674b79598ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:27.005405 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Volume volume-1c27712d-6df1-47b7-b0cf-47c6b5bea42a (1c27712d-6df1-47b7-b0cf-47c6b5bea42a): created successfully Jun 04 21:05:27.017803 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb014100-f2d2-4f19-bbab-2674b79598ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:27.030218 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Flow 'volume_create_manager' (b038550b-a8af-47d4-bc3a-56a3f190b9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:05:27.051129 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c2970240-787d-42a1-8e5c-9b4f364cba32 tempest-ServersTestBootFromVolume-1641932473 None] Created volume successfully. Jun 04 21:05:32.148213 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 req-7bb56d6a-2da3-443d-9606-cbc9c9a4aea3 tempest-ServersTestBootFromVolume-1641932473 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:05:33.288181 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 req-7bb56d6a-2da3-443d-9606-cbc9c9a4aea3 tempest-ServersTestBootFromVolume-1641932473 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.140s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:05:33.289096 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 req-7bb56d6a-2da3-443d-9606-cbc9c9a4aea3 tempest-ServersTestBootFromVolume-1641932473 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1c27712d-6df1-47b7-b0cf-47c6b5bea42a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '1c27712d-6df1-47b7-b0cf-47c6b5bea42a', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:05:33.329418 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 req-7bb56d6a-2da3-443d-9606-cbc9c9a4aea3 tempest-ServersTestBootFromVolume-1641932473 None] Connection info returned from driver {'name': 'volumes/volume-1c27712d-6df1-47b7-b0cf-47c6b5bea42a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1c27712d-6df1-47b7-b0cf-47c6b5bea42a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '98c02550-b8bf-48c4-9507-aa22ec9cdc02'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:05:33.449612 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 req-7bb56d6a-2da3-443d-9606-cbc9c9a4aea3 tempest-ServersTestBootFromVolume-1641932473 None] attachment_update completed successfully. Jun 04 21:05:44.514201 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=6,cinder:SELECT=32,cinder:INSERT=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:45.335884 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:05:45.338743 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:05:45.465067 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:05:45.561416 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:05:52.895381 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8ad27c01-f261-466b-ad1a-4524b494c36d tempest-GroupSnapshotsTest-59407173 None] Group tempest-GroupSnapshotsTest-Group-708159702: creating Jun 04 21:05:52.939005 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8ad27c01-f261-466b-ad1a-4524b494c36d tempest-GroupSnapshotsTest-59407173 None] Group tempest-GroupSnapshotsTest-Group-708159702: created successfully Jun 04 21:05:52.949369 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8ad27c01-f261-466b-ad1a-4524b494c36d tempest-GroupSnapshotsTest-59407173 None] Create group completed successfully. Jun 04 21:05:54.780202 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=34,cinder:UPDATE=6,cinder:INSERT=6,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:54.805190 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:05:54.843820 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Flow 'volume_create_manager' (0dfa0296-7861-4ff4-994e-d31879f61cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:05:54.863099 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1e7438-43f4-4713-918e-9b685d94f029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:54.902086 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1e7438-43f4-4713-918e-9b685d94f029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1479027989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da515836-1473-46fd-a75c-28dec9730b36,host='ncdv-master-1@ceph#ceph',id=802aa339-0569-44dd-b7b1-16b3c007e7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9cacabe3c647c78aee94db67f82472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:05:55Z,use_quota=True,user_id='6518cce1f95a445ab09ba2708c3374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfc2a80b-357e-4d47-a248-6d6c036d5b80),volume_type_id=cfc2a80b-357e-4d47-a248-6d6c036d5b80)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:54.943396 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bbe225-7655-4e2b-b3ea-33ad321d062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:54.970661 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bbe225-7655-4e2b-b3ea-33ad321d062f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:54.993426 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f84010e-dbdf-4de5-9737-242a17fe3fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:54.997593 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f84010e-dbdf-4de5-9737-242a17fe3fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802aa339-0569-44dd-b7b1-16b3c007e7a3', 'volume_name': 'volume-802aa339-0569-44dd-b7b1-16b3c007e7a3', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:55.018906 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71871d57-8d4b-4427-ba73-7da92d6939bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:55.029675 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71871d57-8d4b-4427-ba73-7da92d6939bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:55.034334 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf0a72c-f0dd-4e07-9698-b42189c01027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:55.035498 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Volume 802aa339-0569-44dd-b7b1-16b3c007e7a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802aa339-0569-44dd-b7b1-16b3c007e7a3', 'volume_size': 1} Jun 04 21:05:55.052922 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] creating volume 'volume-802aa339-0569-44dd-b7b1-16b3c007e7a3' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:05:55.054058 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:05:55.227842 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:05:55.228678 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:05:55.233185 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf0a72c-f0dd-4e07-9698-b42189c01027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802aa339-0569-44dd-b7b1-16b3c007e7a3', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:55.244653 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37137055-c652-4fe0-a743-eb8e61ebe65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:05:55.276680 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Volume volume-802aa339-0569-44dd-b7b1-16b3c007e7a3 (802aa339-0569-44dd-b7b1-16b3c007e7a3): created successfully Jun 04 21:05:55.281954 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37137055-c652-4fe0-a743-eb8e61ebe65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:05:55.292138 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Flow 'volume_create_manager' (0dfa0296-7861-4ff4-994e-d31879f61cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:05:55.324667 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0701bbda-67a8-497c-b5b2-1f713f4eb731 tempest-GroupSnapshotsTest-59407173 None] Created volume successfully. Jun 04 21:05:56.582496 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-21236efd-3ebe-48a8-a2e9-0403606982bd tempest-GroupSnapshotsTest-59407173 None] GroupSnapshot 1b2d58c9-c558-458e-9ad5-b40ef2ad1233: creating. Jun 04 21:05:56.649848 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21236efd-3ebe-48a8-a2e9-0403606982bd tempest-GroupSnapshotsTest-59407173 None] Group snapshot 1b2d58c9-c558-458e-9ad5-b40ef2ad1233: creating. {{(pid=130490) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4082}} Jun 04 21:05:56.683030 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-21236efd-3ebe-48a8-a2e9-0403606982bd tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:05:57.842097 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-21236efd-3ebe-48a8-a2e9-0403606982bd tempest-GroupSnapshotsTest-59407173 None] group_snapshot 1b2d58c9-c558-458e-9ad5-b40ef2ad1233: created successfully Jun 04 21:06:00.201316 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2b49fe94-c50f-4e2b-bb70-4316fdd017be tempest-GroupSnapshotsTest-59407173 None] cloning volumes/volume-802aa339-0569-44dd-b7b1-16b3c007e7a3@snapshot-ca408c12-8ad3-441a-987e-17062392b403 to volume-4d2116c4-49dd-4ece-921a-2e2b26415783 {{(pid=130490) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} Jun 04 21:06:00.202292 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2b49fe94-c50f-4e2b-bb70-4316fdd017be tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:00.290004 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2b49fe94-c50f-4e2b-bb70-4316fdd017be tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:00.551048 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2b49fe94-c50f-4e2b-bb70-4316fdd017be tempest-GroupSnapshotsTest-59407173 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:06:00.551767 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2b49fe94-c50f-4e2b-bb70-4316fdd017be tempest-GroupSnapshotsTest-59407173 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:06:00.557903 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2b49fe94-c50f-4e2b-bb70-4316fdd017be tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:00.644241 ncdv-master-1 cinder-volume[130490]: WARNING cinder.volume.drivers.rbd [None req-2b49fe94-c50f-4e2b-bb70-4316fdd017be tempest-GroupSnapshotsTest-59407173 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError Jun 04 21:06:00.805298 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2b49fe94-c50f-4e2b-bb70-4316fdd017be tempest-GroupSnapshotsTest-59407173 None] Create group from source-snapshot-1b2d58c9-c558-458e-9ad5-b40ef2ad1233 completed successfully. Jun 04 21:06:02.177855 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52cb3cae-26ce-41ee-96ab-eee36a092f0c tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:02.302693 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52cb3cae-26ce-41ee-96ab-eee36a092f0c tempest-GroupSnapshotsTest-59407173 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:06:02.345721 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52cb3cae-26ce-41ee-96ab-eee36a092f0c tempest-GroupSnapshotsTest-59407173 None] deleting rbd volume volume-4d2116c4-49dd-4ece-921a-2e2b26415783 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:06:03.159609 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-52cb3cae-26ce-41ee-96ab-eee36a092f0c tempest-GroupSnapshotsTest-59407173 None] Created reservations ['38846dad-5799-40be-881f-9a96a932e4eb'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:03.187393 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-52cb3cae-26ce-41ee-96ab-eee36a092f0c tempest-GroupSnapshotsTest-59407173 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1363260593 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1363260593, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:06:03.190485 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-52cb3cae-26ce-41ee-96ab-eee36a092f0c tempest-GroupSnapshotsTest-59407173 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1363260593 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1363260593, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:06:03.228419 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-52cb3cae-26ce-41ee-96ab-eee36a092f0c tempest-GroupSnapshotsTest-59407173 None] Created reservations ['c862e708-e518-4b15-ac48-4fc767ca1798', '1f7cba33-6761-4763-b709-c101ae3d633e', '4194c7af-395f-4f70-824c-6dc8342fa80a', '56c78596-db0e-47e7-8ab3-9010b5eab2d9'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:03.441597 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52cb3cae-26ce-41ee-96ab-eee36a092f0c tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:03.544270 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-52cb3cae-26ce-41ee-96ab-eee36a092f0c tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:03.601418 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-52cb3cae-26ce-41ee-96ab-eee36a092f0c tempest-GroupSnapshotsTest-59407173 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:06:03.606700 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-52cb3cae-26ce-41ee-96ab-eee36a092f0c tempest-GroupSnapshotsTest-59407173 None] Delete group completed successfully. Jun 04 21:06:04.614141 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e69dee7b-0b34-4ac4-9252-5557b6f94463 tempest-GroupSnapshotsTest-59407173 None] group_snapshot 1b2d58c9-c558-458e-9ad5-b40ef2ad1233: deleting Jun 04 21:06:04.651299 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e69dee7b-0b34-4ac4-9252-5557b6f94463 tempest-GroupSnapshotsTest-59407173 None] group_snapshot 1b2d58c9-c558-458e-9ad5-b40ef2ad1233: deleting {{(pid=130490) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4257}} Jun 04 21:06:04.684852 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e69dee7b-0b34-4ac4-9252-5557b6f94463 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:05.657762 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-e69dee7b-0b34-4ac4-9252-5557b6f94463 tempest-GroupSnapshotsTest-59407173 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1363260593 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1363260593, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:06:05.689848 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-e69dee7b-0b34-4ac4-9252-5557b6f94463 tempest-GroupSnapshotsTest-59407173 None] Created reservations ['ff430e53-6a2d-4cde-90ba-8b58f4ff53eb', '48be9f3e-c1fc-42de-8f5d-e7605d37147b', '3938630d-1702-4dda-a985-5ca5b1d2c6cd', 'bcb13143-fc70-4b09-b821-5bd3cf3c1d23'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:05.808386 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e69dee7b-0b34-4ac4-9252-5557b6f94463 tempest-GroupSnapshotsTest-59407173 None] group_snapshot 1b2d58c9-c558-458e-9ad5-b40ef2ad1233: deleted successfully Jun 04 21:06:06.565732 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-68880e8c-d436-46fb-a8e1-f6dedfd1c311 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:06.663918 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-68880e8c-d436-46fb-a8e1-f6dedfd1c311 tempest-GroupSnapshotsTest-59407173 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:06:06.664614 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-68880e8c-d436-46fb-a8e1-f6dedfd1c311 tempest-GroupSnapshotsTest-59407173 None] Volume volume-802aa339-0569-44dd-b7b1-16b3c007e7a3 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:06:06.678074 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-68880e8c-d436-46fb-a8e1-f6dedfd1c311 tempest-GroupSnapshotsTest-59407173 None] deleting rbd volume volume-802aa339-0569-44dd-b7b1-16b3c007e7a3 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:06:07.672861 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=67,cinder:UPDATE=29,cinder:INSERT=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:07.704408 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=72,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:07.713708 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-68880e8c-d436-46fb-a8e1-f6dedfd1c311 tempest-GroupSnapshotsTest-59407173 None] Created reservations ['c81479d6-f08c-446e-8a26-55f58a5a3a25'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:07.795362 ncdv-master-1 cinder-volume[130490]: WARNING cinder.db.sqlalchemy.api [None req-68880e8c-d436-46fb-a8e1-f6dedfd1c311 tempest-GroupSnapshotsTest-59407173 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1363260593'] Jun 04 21:06:07.801787 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-68880e8c-d436-46fb-a8e1-f6dedfd1c311 tempest-GroupSnapshotsTest-59407173 None] Created reservations ['d2da6350-0829-4c69-9150-a3b14a67a7bb', '2f4e1d59-4c30-437e-a109-49519b245c22', '1e314ac6-4e41-4d2d-9cb3-696c07ee3b11', '4ce25b02-46b6-42cb-aa63-7872e4120cb7'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:07.956855 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-68880e8c-d436-46fb-a8e1-f6dedfd1c311 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:08.042745 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-68880e8c-d436-46fb-a8e1-f6dedfd1c311 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:08.117774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-68880e8c-d436-46fb-a8e1-f6dedfd1c311 tempest-GroupSnapshotsTest-59407173 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:06:08.122271 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-68880e8c-d436-46fb-a8e1-f6dedfd1c311 tempest-GroupSnapshotsTest-59407173 None] Delete group completed successfully. Jun 04 21:06:09.309285 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-28658ebd-c796-4b24-b740-2beac950137a tempest-GroupSnapshotsTest-59407173 None] Group tempest-GroupSnapshotsTest-Group-974395126: creating Jun 04 21:06:09.364249 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-28658ebd-c796-4b24-b740-2beac950137a tempest-GroupSnapshotsTest-59407173 None] Group tempest-GroupSnapshotsTest-Group-974395126: created successfully Jun 04 21:06:09.403183 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-28658ebd-c796-4b24-b740-2beac950137a tempest-GroupSnapshotsTest-59407173 None] Create group completed successfully. Jun 04 21:06:11.227905 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:06:11.285607 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Flow 'volume_create_manager' (a83b8eea-b77e-417d-9365-11ffa9164870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:06:11.302551 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8008d662-58ee-4f99-8474-801cdced783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:11.329997 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8008d662-58ee-4f99-8474-801cdced783b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-2042117488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f53029fa-2774-4bb4-9009-8ce2ff54d304,host='ncdv-master-1@ceph#ceph',id=d24a0097-77b9-403f-8ff4-2b6b2944e6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9cacabe3c647c78aee94db67f82472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:06:11Z,use_quota=True,user_id='6518cce1f95a445ab09ba2708c3374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0f13d36-be9e-462e-8aa1-3f14f5e12e6d),volume_type_id=a0f13d36-be9e-462e-8aa1-3f14f5e12e6d)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:11.337186 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed36fa1e-4bd2-487f-9793-840272af94f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:11.342677 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed36fa1e-4bd2-487f-9793-840272af94f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:11.349045 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2960ccdb-32f6-4a4f-b92b-936b78b0c11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:11.354269 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2960ccdb-32f6-4a4f-b92b-936b78b0c11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24a0097-77b9-403f-8ff4-2b6b2944e6a5', 'volume_name': 'volume-d24a0097-77b9-403f-8ff4-2b6b2944e6a5', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:11.360130 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7fe13a-0b30-40e0-8de0-5a09bb06b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:11.364560 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7fe13a-0b30-40e0-8de0-5a09bb06b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:11.370116 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b16bf4-1ed3-4f5a-b57a-4b43e561e068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:11.371451 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Volume d24a0097-77b9-403f-8ff4-2b6b2944e6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24a0097-77b9-403f-8ff4-2b6b2944e6a5', 'volume_size': 1} Jun 04 21:06:11.372029 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] creating volume 'volume-d24a0097-77b9-403f-8ff4-2b6b2944e6a5' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:06:11.373022 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:11.482187 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:06:11.484471 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:06:11.490277 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b16bf4-1ed3-4f5a-b57a-4b43e561e068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24a0097-77b9-403f-8ff4-2b6b2944e6a5', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:11.496633 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e2366f-1565-4002-9aaa-d03d43e0b279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:11.515467 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Volume volume-d24a0097-77b9-403f-8ff4-2b6b2944e6a5 (d24a0097-77b9-403f-8ff4-2b6b2944e6a5): created successfully Jun 04 21:06:11.522744 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e2366f-1565-4002-9aaa-d03d43e0b279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:11.534412 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Flow 'volume_create_manager' (a83b8eea-b77e-417d-9365-11ffa9164870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:06:11.552564 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8c624c55-fdc0-4c29-ae82-cbf66fb7cc72 tempest-GroupSnapshotsTest-59407173 None] Created volume successfully. Jun 04 21:06:13.057547 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:06:13.101712 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Flow 'volume_create_manager' (ca3c9490-49ab-46a0-b56c-480ff2702ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:06:13.119338 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366c64aa-5d9d-4aa7-a078-97ca45812eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:13.166690 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366c64aa-5d9d-4aa7-a078-97ca45812eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-544438093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f53029fa-2774-4bb4-9009-8ce2ff54d304,host='ncdv-master-1@ceph#ceph',id=9fdd6e5c-778b-4f7c-b27c-22a569406490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9cacabe3c647c78aee94db67f82472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:06:13Z,use_quota=True,user_id='6518cce1f95a445ab09ba2708c3374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0f13d36-be9e-462e-8aa1-3f14f5e12e6d),volume_type_id=a0f13d36-be9e-462e-8aa1-3f14f5e12e6d)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:13.187708 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12d27db-52d8-4851-b268-8709b8aa8a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:13.203679 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12d27db-52d8-4851-b268-8709b8aa8a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:13.215718 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7ab606-2efc-4806-a504-b6602ad154dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:13.224859 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7ab606-2efc-4806-a504-b6602ad154dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fdd6e5c-778b-4f7c-b27c-22a569406490', 'volume_name': 'volume-9fdd6e5c-778b-4f7c-b27c-22a569406490', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:13.234086 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7000b4e-be7c-4073-8dc1-3a1f400d1e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:13.240413 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7000b4e-be7c-4073-8dc1-3a1f400d1e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:13.248320 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0457022-fd5e-4be8-9221-67316660e7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:13.250848 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Volume 9fdd6e5c-778b-4f7c-b27c-22a569406490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fdd6e5c-778b-4f7c-b27c-22a569406490', 'volume_size': 1} Jun 04 21:06:13.251923 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] creating volume 'volume-9fdd6e5c-778b-4f7c-b27c-22a569406490' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:06:13.253115 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:13.475553 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:06:13.475963 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:06:13.479710 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0457022-fd5e-4be8-9221-67316660e7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fdd6e5c-778b-4f7c-b27c-22a569406490', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:13.492835 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5804a42c-cfce-44d9-b301-c82f807aa70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:13.512775 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Volume volume-9fdd6e5c-778b-4f7c-b27c-22a569406490 (9fdd6e5c-778b-4f7c-b27c-22a569406490): created successfully Jun 04 21:06:13.517577 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5804a42c-cfce-44d9-b301-c82f807aa70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:13.528047 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Flow 'volume_create_manager' (ca3c9490-49ab-46a0-b56c-480ff2702ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:06:13.550665 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f6a1a2e6-49d3-43b1-9068-e253f2d07613 tempest-GroupSnapshotsTest-59407173 None] Created volume successfully. Jun 04 21:06:14.382120 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-25126ca2-9f69-45e4-96bf-60bfd4ab0657 tempest-GroupSnapshotsTest-59407173 None] Update group completed successfully. Jun 04 21:06:15.738164 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-43e7056b-2233-4c49-8d8b-9e595eaeb433 tempest-GroupSnapshotsTest-59407173 None] Update group completed successfully. Jun 04 21:06:16.973003 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-fb9ccd3d-5005-4655-9ace-0bd2a0210368 tempest-GroupSnapshotsTest-59407173 None] Update group completed successfully. Jun 04 21:06:18.194398 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-69f17d2c-e359-4a27-bfde-20734a0e67b2 tempest-GroupSnapshotsTest-59407173 None] Update group completed successfully. Jun 04 21:06:20.208752 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1d85512e-9b4b-47bb-9b1f-d512962852ab tempest-GroupSnapshotsTest-59407173 None] GroupSnapshot 2c7c8e46-d977-476f-b7f3-5a9a88ae01c7: creating. Jun 04 21:06:20.288550 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1d85512e-9b4b-47bb-9b1f-d512962852ab tempest-GroupSnapshotsTest-59407173 None] Group snapshot 2c7c8e46-d977-476f-b7f3-5a9a88ae01c7: creating. {{(pid=130490) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4082}} Jun 04 21:06:20.350914 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1d85512e-9b4b-47bb-9b1f-d512962852ab tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:21.263238 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1d85512e-9b4b-47bb-9b1f-d512962852ab tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:22.322449 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1d85512e-9b4b-47bb-9b1f-d512962852ab tempest-GroupSnapshotsTest-59407173 None] group_snapshot 2c7c8e46-d977-476f-b7f3-5a9a88ae01c7: created successfully Jun 04 21:06:22.723153 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-16700ce6-6957-4dab-939a-46ef69ffd65c tempest-GroupSnapshotsTest-59407173 None] group_snapshot 2c7c8e46-d977-476f-b7f3-5a9a88ae01c7: deleting Jun 04 21:06:22.819856 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-16700ce6-6957-4dab-939a-46ef69ffd65c tempest-GroupSnapshotsTest-59407173 None] group_snapshot 2c7c8e46-d977-476f-b7f3-5a9a88ae01c7: deleting {{(pid=130490) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4257}} Jun 04 21:06:22.861507 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-16700ce6-6957-4dab-939a-46ef69ffd65c tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:24.241191 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-16700ce6-6957-4dab-939a-46ef69ffd65c tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:25.522126 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-16700ce6-6957-4dab-939a-46ef69ffd65c tempest-GroupSnapshotsTest-59407173 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1805073418 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1805073418, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:06:25.525707 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-16700ce6-6957-4dab-939a-46ef69ffd65c tempest-GroupSnapshotsTest-59407173 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1805073418 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1805073418, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:06:25.568673 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=74,cinder:INSERT=3,cinder:UPDATE=23 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:25.588945 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-16700ce6-6957-4dab-939a-46ef69ffd65c tempest-GroupSnapshotsTest-59407173 None] Created reservations ['6511144d-d96a-4736-9120-981691731238', 'd65eabdb-cf72-4609-a982-b294a098a18d', '4c42d288-1ae8-4313-ab5b-9b9659a3f88e', '0a2d9060-08e7-48da-9ad0-41c885ee8783'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:25.595232 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=73,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:25.885988 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-16700ce6-6957-4dab-939a-46ef69ffd65c tempest-GroupSnapshotsTest-59407173 None] Created reservations ['6a880de6-a001-4b54-ab8c-bb6d7dc827b4', '95250a2d-6318-4cf7-a736-bc3d141ef92f', 'a3733d69-0ffc-443e-8dca-b7c74eacb6ab', '169a43d8-0a5f-4ee2-8722-6b39b2bfcc85'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:26.033323 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-16700ce6-6957-4dab-939a-46ef69ffd65c tempest-GroupSnapshotsTest-59407173 None] group_snapshot 2c7c8e46-d977-476f-b7f3-5a9a88ae01c7: deleted successfully Jun 04 21:06:26.989379 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:27.084813 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:06:27.085301 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] Volume volume-9fdd6e5c-778b-4f7c-b27c-22a569406490 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:06:27.101678 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] deleting rbd volume volume-9fdd6e5c-778b-4f7c-b27c-22a569406490 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:06:27.931394 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:28.023718 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:06:28.024545 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] Volume volume-d24a0097-77b9-403f-8ff4-2b6b2944e6a5 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:06:28.048382 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] deleting rbd volume volume-d24a0097-77b9-403f-8ff4-2b6b2944e6a5 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:06:29.041124 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] Created reservations ['18ac0d05-61a9-4363-8d96-a7536fd255af'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:29.091076 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1805073418 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1805073418, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:06:29.116044 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] Created reservations ['11f467aa-7c5b-4c0e-9583-cb75a7de7223', '49876291-71b6-4553-8417-1ce2a4fffbf1', '93c0cc8a-91c0-405a-abd7-afb1c507d2ff', '320fa781-9685-4754-af2f-2819506c5ce6'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:29.356161 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] Created reservations ['b691707d-25d1-4845-827c-d859a2133850', 'b6ef32fe-d0f7-4ccd-b36c-4bb25f307aa1', '07d98c1c-fa9c-49a4-ae8a-595b02d465c7', '1e406430-6cb6-41ca-b0be-1ff395df662b'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:29.522446 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:29.644223 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:29.744700 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:06:29.749557 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0257ee25-53f3-4d86-9641-7f6b737d8fe1 tempest-GroupSnapshotsTest-59407173 None] Delete group completed successfully. Jun 04 21:06:31.060319 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-7d3c36dc-18f2-48c9-a24b-dc1571fa7d78 tempest-GroupSnapshotsTest-59407173 None] Group tempest-GroupSnapshotsTest-Group-931648156: creating Jun 04 21:06:31.103256 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-7d3c36dc-18f2-48c9-a24b-dc1571fa7d78 tempest-GroupSnapshotsTest-59407173 None] Group tempest-GroupSnapshotsTest-Group-931648156: created successfully Jun 04 21:06:31.122245 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-7d3c36dc-18f2-48c9-a24b-dc1571fa7d78 tempest-GroupSnapshotsTest-59407173 None] Create group completed successfully. Jun 04 21:06:32.786054 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:06:32.834821 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Flow 'volume_create_manager' (d4d0003a-f14b-4465-85cf-0934623305a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:06:32.844826 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a5c64-2275-44ac-8062-7556308291b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:32.870796 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a5c64-2275-44ac-8062-7556308291b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-988428627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a23c3fec-91ae-4aa7-932e-431598e47edc,host='ncdv-master-1@ceph#ceph',id=ec94bb4f-0dd1-44b2-bff1-3ae03c530a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9cacabe3c647c78aee94db67f82472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:06:33Z,use_quota=True,user_id='6518cce1f95a445ab09ba2708c3374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f597c3-af1f-433f-8747-9880d20246de),volume_type_id=03f597c3-af1f-433f-8747-9880d20246de)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:32.879077 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef916f10-0668-4ab0-85a9-8c3ab695c10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:32.887750 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef916f10-0668-4ab0-85a9-8c3ab695c10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:32.894889 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d2266a-54f3-4717-8c0f-fbaa19a74a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:32.918876 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d2266a-54f3-4717-8c0f-fbaa19a74a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec94bb4f-0dd1-44b2-bff1-3ae03c530a56', 'volume_name': 'volume-ec94bb4f-0dd1-44b2-bff1-3ae03c530a56', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:32.928343 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24e9f986-0559-4f9b-9f4f-74dc1182e17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:32.939988 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24e9f986-0559-4f9b-9f4f-74dc1182e17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:32.950151 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c421eca4-fd08-4da0-9e48-08127aa390cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:32.951194 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Volume ec94bb4f-0dd1-44b2-bff1-3ae03c530a56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec94bb4f-0dd1-44b2-bff1-3ae03c530a56', 'volume_size': 1} Jun 04 21:06:32.951658 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] creating volume 'volume-ec94bb4f-0dd1-44b2-bff1-3ae03c530a56' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:06:32.952469 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:33.129246 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:06:33.129952 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:06:33.133658 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c421eca4-fd08-4da0-9e48-08127aa390cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec94bb4f-0dd1-44b2-bff1-3ae03c530a56', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:33.138110 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177bff45-451f-4363-bc00-2d190ec9164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:33.163976 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Volume volume-ec94bb4f-0dd1-44b2-bff1-3ae03c530a56 (ec94bb4f-0dd1-44b2-bff1-3ae03c530a56): created successfully Jun 04 21:06:33.183572 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177bff45-451f-4363-bc00-2d190ec9164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:33.190508 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Flow 'volume_create_manager' (d4d0003a-f14b-4465-85cf-0934623305a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:06:33.204005 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2fd9b4f9-58e4-4fdd-9b05-f03e207cad63 tempest-GroupSnapshotsTest-59407173 None] Created volume successfully. Jun 04 21:06:34.153159 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-6d94adcc-a7be-492a-8850-282b2151664f tempest-GroupSnapshotsTest-59407173 None] GroupSnapshot 8827a522-6ffb-4a82-b4aa-c2fbc370c8f2: creating. Jun 04 21:06:34.193185 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6d94adcc-a7be-492a-8850-282b2151664f tempest-GroupSnapshotsTest-59407173 None] Group snapshot 8827a522-6ffb-4a82-b4aa-c2fbc370c8f2: creating. {{(pid=130490) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4082}} Jun 04 21:06:34.234523 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6d94adcc-a7be-492a-8850-282b2151664f tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:34.522452 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=60,cinder:UPDATE=36,cinder:INSERT=3,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:35.155149 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-6d94adcc-a7be-492a-8850-282b2151664f tempest-GroupSnapshotsTest-59407173 None] group_snapshot 8827a522-6ffb-4a82-b4aa-c2fbc370c8f2: created successfully Jun 04 21:06:35.445626 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-273ee3d9-a3de-4d4e-9aac-95c8288769a7 tempest-GroupSnapshotsTest-59407173 None] group_snapshot 8827a522-6ffb-4a82-b4aa-c2fbc370c8f2: deleting Jun 04 21:06:35.465065 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-273ee3d9-a3de-4d4e-9aac-95c8288769a7 tempest-GroupSnapshotsTest-59407173 None] group_snapshot 8827a522-6ffb-4a82-b4aa-c2fbc370c8f2: deleting {{(pid=130490) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4257}} Jun 04 21:06:35.484852 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-273ee3d9-a3de-4d4e-9aac-95c8288769a7 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:36.131406 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=60,cinder:UPDATE=30,cinder:INSERT=10 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:36.147180 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-273ee3d9-a3de-4d4e-9aac-95c8288769a7 tempest-GroupSnapshotsTest-59407173 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1148055965 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1148055965, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:06:36.148012 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-273ee3d9-a3de-4d4e-9aac-95c8288769a7 tempest-GroupSnapshotsTest-59407173 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1148055965 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1148055965, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:06:36.170138 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-273ee3d9-a3de-4d4e-9aac-95c8288769a7 tempest-GroupSnapshotsTest-59407173 None] Created reservations ['aa657e22-8ead-4c52-8c69-e9bf9456508b', '7797e0e4-f4a0-4542-ba57-bd3ee48d8809', 'f9ae2a4d-0c30-4718-bb72-968e51a7ad6c', 'f10228f3-cc31-49ce-8d0f-879a0ad4982e'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:36.242023 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-273ee3d9-a3de-4d4e-9aac-95c8288769a7 tempest-GroupSnapshotsTest-59407173 None] group_snapshot 8827a522-6ffb-4a82-b4aa-c2fbc370c8f2: deleted successfully Jun 04 21:06:37.158519 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d4352b61-5234-43d5-90a9-a23dd33c6f23 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:37.258434 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d4352b61-5234-43d5-90a9-a23dd33c6f23 tempest-GroupSnapshotsTest-59407173 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:06:37.259153 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d4352b61-5234-43d5-90a9-a23dd33c6f23 tempest-GroupSnapshotsTest-59407173 None] Volume volume-ec94bb4f-0dd1-44b2-bff1-3ae03c530a56 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:06:37.270725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d4352b61-5234-43d5-90a9-a23dd33c6f23 tempest-GroupSnapshotsTest-59407173 None] deleting rbd volume volume-ec94bb4f-0dd1-44b2-bff1-3ae03c530a56 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:06:38.062983 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-d4352b61-5234-43d5-90a9-a23dd33c6f23 tempest-GroupSnapshotsTest-59407173 None] Created reservations ['36ab57c6-7adc-48b8-b162-3af875119912'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:38.087567 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-d4352b61-5234-43d5-90a9-a23dd33c6f23 tempest-GroupSnapshotsTest-59407173 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1148055965 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1148055965, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:06:38.109201 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-d4352b61-5234-43d5-90a9-a23dd33c6f23 tempest-GroupSnapshotsTest-59407173 None] Created reservations ['abf91f32-3b1c-479d-992d-59250377df66', '892df11e-4854-4710-ac22-a78afea92a4e', '6661ba85-b44d-46e1-a68e-7faa3d8944d9', '1ca8a8d7-3e18-4f33-961a-90f88149c2fe'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:38.219842 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d4352b61-5234-43d5-90a9-a23dd33c6f23 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:38.255197 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d4352b61-5234-43d5-90a9-a23dd33c6f23 tempest-GroupSnapshotsTest-59407173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:38.307396 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-d4352b61-5234-43d5-90a9-a23dd33c6f23 tempest-GroupSnapshotsTest-59407173 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:06:38.313208 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-d4352b61-5234-43d5-90a9-a23dd33c6f23 tempest-GroupSnapshotsTest-59407173 None] Delete group completed successfully. Jun 04 21:06:45.331851 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:06:45.333335 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:45.407671 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:45.475274 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:06:45.509237 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a3ea7eaf-9626-4dd2-9e93-7b994857e16b tempest-GroupsV320Test-796076576 None] Group tempest-GroupsV320Test-Group-1240140419: creating Jun 04 21:06:45.538841 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a3ea7eaf-9626-4dd2-9e93-7b994857e16b tempest-GroupsV320Test-796076576 None] Group tempest-GroupsV320Test-Group-1240140419: created successfully Jun 04 21:06:45.552140 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a3ea7eaf-9626-4dd2-9e93-7b994857e16b tempest-GroupsV320Test-796076576 None] Create group completed successfully. Jun 04 21:06:47.179012 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-25e2d821-0589-4326-ae63-cdd5e1a36da2 tempest-GroupsV320Test-796076576 None] Created reservations ['66cddf53-3f22-4b19-b79d-6d31d336da23'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:06:47.235985 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-25e2d821-0589-4326-ae63-cdd5e1a36da2 tempest-GroupsV320Test-796076576 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:47.300801 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-25e2d821-0589-4326-ae63-cdd5e1a36da2 tempest-GroupsV320Test-796076576 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:47.390564 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-25e2d821-0589-4326-ae63-cdd5e1a36da2 tempest-GroupsV320Test-796076576 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:06:47.413724 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-25e2d821-0589-4326-ae63-cdd5e1a36da2 tempest-GroupsV320Test-796076576 None] Delete group completed successfully. Jun 04 21:06:55.776292 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:06:55.842004 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Flow 'volume_create_manager' (26baff35-8d1e-4b6b-b924-db2cdd85c6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:06:55.873950 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cb17ef-15c3-432d-9a0e-d2e424746be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:55.898367 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cb17ef-15c3-432d-9a0e-d2e424746be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2023061254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7ab4c29-58c8-434c-bd07-2af54693744d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6190607daae4497896d8e5e2805c027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:06:56Z,use_quota=True,user_id='b9f8b3c9c3e246a1b5732248f352f6f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:55.915341 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a303a29-fe0f-4621-b827-30217f595f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:55.926875 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a303a29-fe0f-4621-b827-30217f595f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:55.940847 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab7a3c6-0886-4550-bd80-f4f4e4408057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:55.975655 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab7a3c6-0886-4550-bd80-f4f4e4408057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ab4c29-58c8-434c-bd07-2af54693744d', 'volume_name': 'volume-f7ab4c29-58c8-434c-bd07-2af54693744d', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:55.982107 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c196e68c-91d2-4cc4-babd-506b1c78eb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:56.000158 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c196e68c-91d2-4cc4-babd-506b1c78eb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:56.005960 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571efcf4-1a37-4b28-812f-3c184866070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:56.007563 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Volume f7ab4c29-58c8-434c-bd07-2af54693744d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ab4c29-58c8-434c-bd07-2af54693744d', 'volume_size': 1} Jun 04 21:06:56.008825 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] creating volume 'volume-f7ab4c29-58c8-434c-bd07-2af54693744d' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:06:56.010097 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:56.141084 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:06:56.141459 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:06:56.146377 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571efcf4-1a37-4b28-812f-3c184866070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ab4c29-58c8-434c-bd07-2af54693744d', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:56.151392 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b668ab-2124-4d94-8675-653b6dca0e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:06:56.168943 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=63,cinder:UPDATE=31,cinder:INSERT=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:56.184474 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Volume volume-f7ab4c29-58c8-434c-bd07-2af54693744d (f7ab4c29-58c8-434c-bd07-2af54693744d): created successfully Jun 04 21:06:56.190173 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b668ab-2124-4d94-8675-653b6dca0e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:06:56.202029 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Flow 'volume_create_manager' (26baff35-8d1e-4b6b-b924-db2cdd85c6a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:06:56.236301 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ab8be98e-e13e-44d5-89d8-09e82380bced tempest-SnapshotsActionsTest-2003004847 None] Created volume successfully. Jun 04 21:06:57.167371 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6f1cf5ef-64c5-44df-939e-58ed6477bacd tempest-SnapshotsActionsTest-2003004847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:06:58.447303 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-6f1cf5ef-64c5-44df-939e-58ed6477bacd tempest-SnapshotsActionsTest-2003004847 None] Create snapshot completed successfully Jun 04 21:06:59.940644 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-22f698e9-6416-43af-893d-a2cf47b4c21b tempest-SnapshotsActionsTest-2003004847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:00.582452 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-22f698e9-6416-43af-893d-a2cf47b4c21b tempest-SnapshotsActionsTest-2003004847 None] Create snapshot completed successfully Jun 04 21:07:01.344252 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f7f105d2-523e-4934-8335-f14abe87606d tempest-SnapshotsActionsTest-128462918 None] Lock "b'cinder-23d92c79-d251-4761-858f-ef013987d0aa-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:01.347878 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f7f105d2-523e-4934-8335-f14abe87606d tempest-SnapshotsActionsTest-128462918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:02.594737 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-f7f105d2-523e-4934-8335-f14abe87606d tempest-SnapshotsActionsTest-128462918 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:07:02.613864 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-f7f105d2-523e-4934-8335-f14abe87606d tempest-SnapshotsActionsTest-128462918 None] Created reservations ['c121e275-dfc1-4f6b-9518-ea0d33f457b0', 'f99114bc-3f04-43ca-a003-0fb9c693d474', 'd0241f6b-216e-4858-b26d-003cee8926a3', 'b938c3c0-8d7e-4455-afc0-249d0125c286'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:02.659019 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f7f105d2-523e-4934-8335-f14abe87606d tempest-SnapshotsActionsTest-128462918 None] Delete snapshot completed successfully. Jun 04 21:07:02.665737 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f7f105d2-523e-4934-8335-f14abe87606d tempest-SnapshotsActionsTest-128462918 None] Lock "b'cinder-23d92c79-d251-4761-858f-ef013987d0aa-delete_snapshot'" released by "delete_snapshot" :: held 1.322s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:03.937022 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b4b88990-409c-4019-9837-f1bec6365f7a tempest-SnapshotsActionsTest-2003004847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:04.670224 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b4b88990-409c-4019-9837-f1bec6365f7a tempest-SnapshotsActionsTest-2003004847 None] Create snapshot completed successfully Jun 04 21:07:05.218499 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-e83ce333-a569-4820-b0f7-1d688f5e14ba tempest-SnapshotsActionsTest-128462918 None] Lock "b'cinder-f545c9cb-e477-4e0f-b529-23e82c977daa-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.029s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:05.225054 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e83ce333-a569-4820-b0f7-1d688f5e14ba tempest-SnapshotsActionsTest-128462918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:05.685064 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:INSERT=6,cinder:SELECT=68,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:05.783470 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-e83ce333-a569-4820-b0f7-1d688f5e14ba tempest-SnapshotsActionsTest-128462918 None] Created reservations ['a99cf4d4-b1d2-4516-9154-a5be46f75150', 'e766927e-69c6-42fe-9b85-d1f5d3e8ba12', 'aae77353-294a-4592-b5a7-fdcfafdaee1f', '26453889-e21d-4210-b923-d94e31b214a6'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:05.865290 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e83ce333-a569-4820-b0f7-1d688f5e14ba tempest-SnapshotsActionsTest-128462918 None] Delete snapshot completed successfully. Jun 04 21:07:05.873164 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-e83ce333-a569-4820-b0f7-1d688f5e14ba tempest-SnapshotsActionsTest-128462918 None] Lock "b'cinder-f545c9cb-e477-4e0f-b529-23e82c977daa-delete_snapshot'" released by "delete_snapshot" :: held 0.653s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:06.734029 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-49c9cc93-05a2-49be-9786-b05bcac23fae tempest-SnapshotsActionsTest-2003004847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:07.840516 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-49c9cc93-05a2-49be-9786-b05bcac23fae tempest-SnapshotsActionsTest-2003004847 None] Create snapshot completed successfully Jun 04 21:07:09.029345 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-bfd7c02d-5cc7-4618-91f1-60b84c4551c1 tempest-SnapshotsActionsTest-128462918 None] Lock "b'cinder-c5fa9e53-23d8-4653-8bcb-d15c0cdcdf61-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:09.031199 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bfd7c02d-5cc7-4618-91f1-60b84c4551c1 tempest-SnapshotsActionsTest-128462918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:09.667392 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-bfd7c02d-5cc7-4618-91f1-60b84c4551c1 tempest-SnapshotsActionsTest-128462918 None] Created reservations ['d13abfc7-c4f5-4e19-88be-837f065f84a5', '80d4f3c5-5de4-4204-bf91-799be3da0214', '06a01d72-df70-4a23-9ba1-2553c0d4f7cb', '2807d9fa-2b16-40ae-a424-9b2475c8b0d4'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:09.776880 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-bfd7c02d-5cc7-4618-91f1-60b84c4551c1 tempest-SnapshotsActionsTest-128462918 None] Delete snapshot completed successfully. Jun 04 21:07:09.785382 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-bfd7c02d-5cc7-4618-91f1-60b84c4551c1 tempest-SnapshotsActionsTest-128462918 None] Lock "b'cinder-c5fa9e53-23d8-4653-8bcb-d15c0cdcdf61-delete_snapshot'" released by "delete_snapshot" :: held 0.756s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:10.685925 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8bd1e6a9-151a-4ae8-857b-b066acffead4 tempest-SnapshotsActionsTest-2003004847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:11.684090 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8bd1e6a9-151a-4ae8-857b-b066acffead4 tempest-SnapshotsActionsTest-2003004847 None] Create snapshot completed successfully Jun 04 21:07:11.985755 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-e4528143-7f83-424e-993a-bd1b6605e870 tempest-SnapshotsActionsTest-128462918 None] Lock "b'cinder-e98e262b-a2d1-4b0e-b419-3f29f7c6f50e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:11.992464 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e4528143-7f83-424e-993a-bd1b6605e870 tempest-SnapshotsActionsTest-128462918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:12.597160 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-e4528143-7f83-424e-993a-bd1b6605e870 tempest-SnapshotsActionsTest-128462918 None] Created reservations ['c3981e8f-7a0d-4b18-b929-bf4a9a515052', '3fb8312e-35eb-4485-9887-dc7efd079961', '1d8b96bb-40d0-469e-95c4-a1bf589ebc83', 'f15f152b-1d70-4357-9d7b-809912dfabe7'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:12.681540 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=64,cinder:DELETE=3,cinder:UPDATE=26,cinder:INSERT=7 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:12.692495 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e4528143-7f83-424e-993a-bd1b6605e870 tempest-SnapshotsActionsTest-128462918 None] Delete snapshot completed successfully. Jun 04 21:07:12.707286 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-e4528143-7f83-424e-993a-bd1b6605e870 tempest-SnapshotsActionsTest-128462918 None] Lock "b'cinder-e98e262b-a2d1-4b0e-b419-3f29f7c6f50e-delete_snapshot'" released by "delete_snapshot" :: held 0.721s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:13.834361 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-37d63b4c-980b-43c3-96dc-ab2735695a55 tempest-SnapshotsActionsTest-2003004847 None] Lock "b'cinder-122803d3-4613-4437-af34-ab84e9f3aeb5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:13.837805 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-37d63b4c-980b-43c3-96dc-ab2735695a55 tempest-SnapshotsActionsTest-2003004847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:14.663658 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-37d63b4c-980b-43c3-96dc-ab2735695a55 tempest-SnapshotsActionsTest-2003004847 None] Created reservations ['1a48ef1a-84db-4f1d-813f-0e4da45ff8c4', 'fa2e1420-bc84-4e0a-b1bc-e099d697cb83', '17045b23-f2ca-40c9-b4a2-88b0b3f45ae5', 'e9ec0dd1-1e3f-4e91-b4cb-4c079845db56'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:14.787007 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-37d63b4c-980b-43c3-96dc-ab2735695a55 tempest-SnapshotsActionsTest-2003004847 None] Delete snapshot completed successfully. Jun 04 21:07:14.793051 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-37d63b4c-980b-43c3-96dc-ab2735695a55 tempest-SnapshotsActionsTest-2003004847 None] Lock "b'cinder-122803d3-4613-4437-af34-ab84e9f3aeb5-delete_snapshot'" released by "delete_snapshot" :: held 0.961s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:15.015113 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-214fab07-834e-4e33-81df-03d19e8d8b68 tempest-SnapshotsActionsTest-2003004847 None] Lock "b'cinder-f7ab4c29-58c8-434c-bd07-2af54693744d-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:15.093516 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-214fab07-834e-4e33-81df-03d19e8d8b68 tempest-SnapshotsActionsTest-2003004847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:15.192681 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-214fab07-834e-4e33-81df-03d19e8d8b68 tempest-SnapshotsActionsTest-2003004847 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:07:15.193385 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-214fab07-834e-4e33-81df-03d19e8d8b68 tempest-SnapshotsActionsTest-2003004847 None] Volume volume-f7ab4c29-58c8-434c-bd07-2af54693744d is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:07:15.203624 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-214fab07-834e-4e33-81df-03d19e8d8b68 tempest-SnapshotsActionsTest-2003004847 None] deleting rbd volume volume-f7ab4c29-58c8-434c-bd07-2af54693744d {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:07:15.633031 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-214fab07-834e-4e33-81df-03d19e8d8b68 tempest-SnapshotsActionsTest-2003004847 None] Created reservations ['e1a2e45b-9d4f-476c-997d-06ba1bc43766', '1258fe3f-1ce8-4801-9052-57f530001d03', 'dd1b10f4-4e71-4197-948f-b0fd78e18258', '489f0e33-550e-4272-a6c9-6232279f4891'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:15.708043 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:INSERT=9,cinder:SELECT=51,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:15.730642 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-214fab07-834e-4e33-81df-03d19e8d8b68 tempest-SnapshotsActionsTest-2003004847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:15.811067 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-214fab07-834e-4e33-81df-03d19e8d8b68 tempest-SnapshotsActionsTest-2003004847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:15.886225 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-214fab07-834e-4e33-81df-03d19e8d8b68 tempest-SnapshotsActionsTest-2003004847 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:07:15.913352 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-214fab07-834e-4e33-81df-03d19e8d8b68 tempest-SnapshotsActionsTest-2003004847 None] Deleted volume successfully. Jun 04 21:07:15.939721 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-214fab07-834e-4e33-81df-03d19e8d8b68 tempest-SnapshotsActionsTest-2003004847 None] Lock "b'cinder-f7ab4c29-58c8-434c-bd07-2af54693744d-delete_volume'" released by "delete_volume" :: held 0.925s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:19.921978 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-5c8296f1-b147-484a-879e-45bd48330738 req-953f01ae-cc5c-49ea-b892-a82d94e35aed tempest-ServersTestBootFromVolume-1641932473 None] Terminate volume connection completed successfully. Jun 04 21:07:19.923728 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-5c8296f1-b147-484a-879e-45bd48330738 req-953f01ae-cc5c-49ea-b892-a82d94e35aed tempest-ServersTestBootFromVolume-1641932473 None] Deleting attachment 98c02550-b8bf-48c4-9507-aa22ec9cdc02. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:07:20.289260 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] Lock "b'cinder-1c27712d-6df1-47b7-b0cf-47c6b5bea42a-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:20.463622 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:20.616426 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:07:20.636601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] deleting rbd volume volume-1c27712d-6df1-47b7-b0cf-47c6b5bea42a {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:07:21.331293 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:07:21.404021 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] deleting parent snapshot volume-1c27712d-6df1-47b7-b0cf-47c6b5bea42a.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:07:22.651043 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] Created reservations ['254f5ffe-6a85-44bc-949a-8d5d716facc5', '8b3756ea-fef8-439a-a595-a4ec781245bf', 'f6130663-afd5-419a-9f70-19e699b0d136', 'b4e8ac24-8234-4613-bcda-a41fde017610'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:22.788153 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:22.829552 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:22.892686 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:07:22.906940 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] Deleted volume successfully. Jun 04 21:07:22.971060 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-5c8296f1-b147-484a-879e-45bd48330738 req-4c48788d-a27b-4548-b41c-400f0a138045 tempest-ServersTestBootFromVolume-1641932473 None] Lock "b'cinder-1c27712d-6df1-47b7-b0cf-47c6b5bea42a-delete_volume'" released by "delete_volume" :: held 2.660s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:25.206592 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc req-ec25efb6-2b87-4a74-aabc-2201142ab692 tempest-TaggedBootDevicesTest-1959467912 None] Terminate volume connection completed successfully. Jun 04 21:07:25.209111 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc req-ec25efb6-2b87-4a74-aabc-2201142ab692 tempest-TaggedBootDevicesTest-1959467912 None] Deleting attachment 796254de-5937-410d-a1ea-641ab6f51ac8. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:07:25.431920 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc req-e2c26e3f-a67f-426d-9b8c-c430c46be91e tempest-TaggedBootDevicesTest-1959467912 None] Terminate volume connection completed successfully. Jun 04 21:07:25.432599 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc req-e2c26e3f-a67f-426d-9b8c-c430c46be91e tempest-TaggedBootDevicesTest-1959467912 None] Deleting attachment 31020dbd-bd97-4bbf-b0d0-f2f1e9841e30. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:07:25.629172 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc req-ad0d8fb6-487f-4f9e-a970-ad61a2411e18 tempest-TaggedBootDevicesTest-1959467912 None] Terminate volume connection completed successfully. Jun 04 21:07:25.630343 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc req-ad0d8fb6-487f-4f9e-a970-ad61a2411e18 tempest-TaggedBootDevicesTest-1959467912 None] Deleting attachment 9e5e0797-590e-4a9d-8449-a92e6b9f6d38. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:07:25.881626 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:07:25.918309 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Flow 'volume_create_manager' (63eb2645-e008-4f94-8249-4738b1e1c9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:25.928986 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9380aba1-a122-4b24-b226-e9739f782235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:25.953618 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9380aba1-a122-4b24-b226-e9739f782235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1769979006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e1f26eb-718c-4a22-9187-1a4cc4633b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9d3208d0ab4944a80883344ecc2401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:07:26Z,use_quota=True,user_id='366c6fde120846d89fa9789cd29ca862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d4880ea-f0b7-4956-ada9-87e7940bdf93),volume_type_id=2d4880ea-f0b7-4956-ada9-87e7940bdf93)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:25.973323 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04eb9bf-7469-491a-9178-7a4fac449455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:25.981498 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04eb9bf-7469-491a-9178-7a4fac449455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:25.995635 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9193d8-21b8-4dca-aaa9-4bec56279da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:26.001007 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9193d8-21b8-4dca-aaa9-4bec56279da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1f26eb-718c-4a22-9187-1a4cc4633b7a', 'volume_name': 'volume-0e1f26eb-718c-4a22-9187-1a4cc4633b7a', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:26.008419 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655b3cf8-2baf-4631-8974-53caf43795c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:26.014084 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655b3cf8-2baf-4631-8974-53caf43795c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:26.021539 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da1fc2d-30fe-4f88-84be-0d5b5f3325a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:26.023656 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Volume 0e1f26eb-718c-4a22-9187-1a4cc4633b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1f26eb-718c-4a22-9187-1a4cc4633b7a', 'volume_size': 1} Jun 04 21:07:26.024428 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] creating volume 'volume-0e1f26eb-718c-4a22-9187-1a4cc4633b7a' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:07:26.026034 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:26.171840 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:07:26.172202 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:07:26.175818 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da1fc2d-30fe-4f88-84be-0d5b5f3325a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1f26eb-718c-4a22-9187-1a4cc4633b7a', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:26.183832 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774b18d9-2570-492f-97ce-75b6375b62fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:26.199412 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Volume volume-0e1f26eb-718c-4a22-9187-1a4cc4633b7a (0e1f26eb-718c-4a22-9187-1a4cc4633b7a): created successfully Jun 04 21:07:26.203085 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774b18d9-2570-492f-97ce-75b6375b62fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:26.208497 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Flow 'volume_create_manager' (63eb2645-e008-4f94-8249-4738b1e1c9d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:26.232362 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-7994df18-09f7-4eda-a02f-727700edf17f tempest-VolumeTypesAccessTest-1647821869 None] Created volume successfully. Jun 04 21:07:27.693856 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] Lock "b'cinder-0e1f26eb-718c-4a22-9187-1a4cc4633b7a-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:27.838189 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:27.954382 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:07:27.954992 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] Volume volume-0e1f26eb-718c-4a22-9187-1a4cc4633b7a is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:07:27.982783 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] deleting rbd volume volume-0e1f26eb-718c-4a22-9187-1a4cc4633b7a {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:07:28.618062 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-119236215 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-119236215, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:07:28.619244 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-119236215 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-119236215, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:07:28.650622 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] Created reservations ['e7ae4d79-d419-4b4d-a286-0b3e1c6b10d2', 'b2c53a33-9ca6-4e9c-9f16-b8b875caf689', '469b5ba0-d229-41cf-9ab7-99fc424dfc82', '9f1cf4fb-c9fc-4e41-9e05-6319b68fd83c'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:28.750436 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=58,cinder:UPDATE=30,cinder:INSERT=9,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:28.783291 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:28.898068 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:28.988505 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:07:28.993281 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] Deleted volume successfully. Jun 04 21:07:29.020035 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3c2328b0-27a1-4618-9a87-e3e13153fc99 tempest-VolumeTypesAccessTest-1647821869 None] Lock "b'cinder-0e1f26eb-718c-4a22-9187-1a4cc4633b7a-delete_volume'" released by "delete_volume" :: held 1.326s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:30.033165 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:07:30.061209 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Flow 'volume_create_manager' (886fe987-f6be-4c43-933c-b25548763036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:30.069036 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55378789-0e6e-41bd-b03f-b1a2eb1671c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:30.092189 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55378789-0e6e-41bd-b03f-b1a2eb1671c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-875896000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=95700618-6da4-4410-8224-5fe706fb560d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfea83c42bb443459619d4d679aa1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:07:30Z,use_quota=True,user_id='f290b5d01a074e2c9859488bd4ff1162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:30.099746 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b258f05-ec82-4e7a-ac11-8cb602896b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:30.104546 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b258f05-ec82-4e7a-ac11-8cb602896b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:30.111617 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02870085-5985-4e44-92bb-0604082f61a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:30.121325 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02870085-5985-4e44-92bb-0604082f61a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95700618-6da4-4410-8224-5fe706fb560d', 'volume_name': 'volume-95700618-6da4-4410-8224-5fe706fb560d', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:30.136015 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404673e2-eba7-4e06-8ef2-7c0fe9e2566f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:30.156226 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404673e2-eba7-4e06-8ef2-7c0fe9e2566f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:30.162472 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293b7cca-c45c-4099-b392-0dd830ab964a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:30.163086 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Volume 95700618-6da4-4410-8224-5fe706fb560d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95700618-6da4-4410-8224-5fe706fb560d', 'volume_size': 1} Jun 04 21:07:30.163681 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] creating volume 'volume-95700618-6da4-4410-8224-5fe706fb560d' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:07:30.164789 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:30.301031 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:07:30.301481 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:07:30.305570 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293b7cca-c45c-4099-b392-0dd830ab964a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95700618-6da4-4410-8224-5fe706fb560d', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:30.311153 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751a9825-ff65-4ac2-922c-27c63c511f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:30.325260 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Volume volume-95700618-6da4-4410-8224-5fe706fb560d (95700618-6da4-4410-8224-5fe706fb560d): created successfully Jun 04 21:07:30.338818 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751a9825-ff65-4ac2-922c-27c63c511f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:30.376814 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Flow 'volume_create_manager' (886fe987-f6be-4c43-933c-b25548763036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:30.407999 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3e8a89d6-ff6f-4189-8078-adb1531a1f00 tempest-AttachVolumeTestJSON-1210396921 None] Created volume successfully. Jun 04 21:07:31.881288 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-5f9472da-945e-445a-ab52-20d265c14f77 req-8ffd6c93-d7e0-4200-a298-f54b4664bf72 tempest-AttachVolumeTestJSON-1210396921 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:07:32.854642 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-5f9472da-945e-445a-ab52-20d265c14f77 req-8ffd6c93-d7e0-4200-a298-f54b4664bf72 tempest-AttachVolumeTestJSON-1210396921 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.973s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:07:32.855479 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-5f9472da-945e-445a-ab52-20d265c14f77 req-8ffd6c93-d7e0-4200-a298-f54b4664bf72 tempest-AttachVolumeTestJSON-1210396921 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-95700618-6da4-4410-8224-5fe706fb560d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '95700618-6da4-4410-8224-5fe706fb560d', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:07:32.916362 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-5f9472da-945e-445a-ab52-20d265c14f77 req-8ffd6c93-d7e0-4200-a298-f54b4664bf72 tempest-AttachVolumeTestJSON-1210396921 None] Connection info returned from driver {'name': 'volumes/volume-95700618-6da4-4410-8224-5fe706fb560d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '95700618-6da4-4410-8224-5fe706fb560d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3bdc1433-7b69-4d9f-a901-3988776854ee'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:07:33.053797 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-5f9472da-945e-445a-ab52-20d265c14f77 req-8ffd6c93-d7e0-4200-a298-f54b4664bf72 tempest-AttachVolumeTestJSON-1210396921 None] attachment_update completed successfully. Jun 04 21:07:38.435487 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c84b1b98-c918-47f1-ad00-863e26c6c9ab tempest-TaggedBootDevicesTest-1959467912 None] Lock "b'cinder-f599bf47-2ed2-4605-a2b8-f112ebbf3bca-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:38.482068 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c84b1b98-c918-47f1-ad00-863e26c6c9ab tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:38.541183 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c84b1b98-c918-47f1-ad00-863e26c6c9ab tempest-TaggedBootDevicesTest-1959467912 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:07:38.541776 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c84b1b98-c918-47f1-ad00-863e26c6c9ab tempest-TaggedBootDevicesTest-1959467912 None] Volume volume-f599bf47-2ed2-4605-a2b8-f112ebbf3bca is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:07:38.551697 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c84b1b98-c918-47f1-ad00-863e26c6c9ab tempest-TaggedBootDevicesTest-1959467912 None] deleting rbd volume volume-f599bf47-2ed2-4605-a2b8-f112ebbf3bca {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:07:39.001386 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-c84b1b98-c918-47f1-ad00-863e26c6c9ab tempest-TaggedBootDevicesTest-1959467912 None] Created reservations ['644b1b90-a013-4e08-98c9-ef7f7ee446bf', '538577ef-8ffa-4c0d-b3cd-06b436358957', 'a2a7b190-de40-4fe7-91e3-ba5fdff2e057', '3367a03e-705c-4e07-bbf8-75d16d5dabad'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:39.091447 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c84b1b98-c918-47f1-ad00-863e26c6c9ab tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:39.169665 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c84b1b98-c918-47f1-ad00-863e26c6c9ab tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:39.251334 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-c84b1b98-c918-47f1-ad00-863e26c6c9ab tempest-TaggedBootDevicesTest-1959467912 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:07:39.257862 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c84b1b98-c918-47f1-ad00-863e26c6c9ab tempest-TaggedBootDevicesTest-1959467912 None] Deleted volume successfully. Jun 04 21:07:39.279189 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c84b1b98-c918-47f1-ad00-863e26c6c9ab tempest-TaggedBootDevicesTest-1959467912 None] Lock "b'cinder-f599bf47-2ed2-4605-a2b8-f112ebbf3bca-delete_volume'" released by "delete_volume" :: held 0.844s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:39.675921 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-16891335-7449-4867-a6f1-0acfd4963979 tempest-TaggedBootDevicesTest-1959467912 None] Lock "b'cinder-6b1fd212-16d5-4e38-9bf7-191bb6888943-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:39.847414 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-16891335-7449-4867-a6f1-0acfd4963979 tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:39.952364 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-16891335-7449-4867-a6f1-0acfd4963979 tempest-TaggedBootDevicesTest-1959467912 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:07:39.953177 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-16891335-7449-4867-a6f1-0acfd4963979 tempest-TaggedBootDevicesTest-1959467912 None] Volume volume-6b1fd212-16d5-4e38-9bf7-191bb6888943 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:07:39.969550 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-16891335-7449-4867-a6f1-0acfd4963979 tempest-TaggedBootDevicesTest-1959467912 None] deleting rbd volume volume-6b1fd212-16d5-4e38-9bf7-191bb6888943 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:07:40.050898 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:07:40.079250 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Flow 'volume_create_manager' (4e1ac483-ad9a-41f1-a1b0-a42e56d6d883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:40.088571 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53ae6db-26c5-4a05-998d-ed638a719924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:40.124599 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53ae6db-26c5-4a05-998d-ed638a719924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1097318860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ae3f86e6-2bca-4e03-9357-b20d0883f893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98fc977ca1e415aa56d63e901a9acaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:07:40Z,use_quota=True,user_id='d09873cd5b94494a82b44cd5a3920dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:40.132087 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f2167a-c733-4ead-9cf8-2683d2405758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:40.139962 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f2167a-c733-4ead-9cf8-2683d2405758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:40.149023 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5910a72e-6376-434e-ae57-b1a71e83086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:40.155877 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5910a72e-6376-434e-ae57-b1a71e83086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3f86e6-2bca-4e03-9357-b20d0883f893', 'volume_name': 'volume-ae3f86e6-2bca-4e03-9357-b20d0883f893', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:40.172981 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa42044-bd5a-40b4-9ffa-3779492a292a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:40.177418 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa42044-bd5a-40b4-9ffa-3779492a292a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:40.182897 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82784af-1221-4bca-9168-355c930c857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:40.184256 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Volume ae3f86e6-2bca-4e03-9357-b20d0883f893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3f86e6-2bca-4e03-9357-b20d0883f893', 'volume_size': 1} Jun 04 21:07:40.185922 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] creating volume 'volume-ae3f86e6-2bca-4e03-9357-b20d0883f893' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:07:40.186867 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:40.330510 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:07:40.331379 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:07:40.339959 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82784af-1221-4bca-9168-355c930c857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3f86e6-2bca-4e03-9357-b20d0883f893', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:40.350506 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029f3ed0-70e7-4b79-a71f-befe6c571050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:40.361350 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=66,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:40.386042 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Volume volume-ae3f86e6-2bca-4e03-9357-b20d0883f893 (ae3f86e6-2bca-4e03-9357-b20d0883f893): created successfully Jun 04 21:07:40.403482 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029f3ed0-70e7-4b79-a71f-befe6c571050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:40.410476 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Flow 'volume_create_manager' (4e1ac483-ad9a-41f1-a1b0-a42e56d6d883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:40.444331 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b189b3e1-d8f3-4e98-9318-498f9734ef55 tempest-VolumesListAdminTestJSON-496465563 None] Created volume successfully. Jun 04 21:07:40.523960 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-16891335-7449-4867-a6f1-0acfd4963979 tempest-TaggedBootDevicesTest-1959467912 None] Created reservations ['d78f037f-0932-4f65-aef9-9f959a7cf995', '644ea878-33c3-4891-bb99-3793daea6bdd', '6d0c198c-05c3-42f6-ae16-256740b896b0', 'a6db30ce-1ba8-4130-90e7-d759f3532c40'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:40.587256 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-16891335-7449-4867-a6f1-0acfd4963979 tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:40.635275 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-16891335-7449-4867-a6f1-0acfd4963979 tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:40.702836 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-16891335-7449-4867-a6f1-0acfd4963979 tempest-TaggedBootDevicesTest-1959467912 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:07:40.707698 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-16891335-7449-4867-a6f1-0acfd4963979 tempest-TaggedBootDevicesTest-1959467912 None] Deleted volume successfully. Jun 04 21:07:40.727592 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-16891335-7449-4867-a6f1-0acfd4963979 tempest-TaggedBootDevicesTest-1959467912 None] Lock "b'cinder-6b1fd212-16d5-4e38-9bf7-191bb6888943-delete_volume'" released by "delete_volume" :: held 1.056s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:41.052498 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] Lock "b'cinder-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:41.150719 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:41.258637 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:07:41.268163 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] deleting rbd volume volume-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:07:41.566235 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:07:41.593858 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Flow 'volume_create_manager' (348d2571-8f15-4fe6-a6da-dd2d9e65d5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:41.614744 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3fa02c-7d7e-442f-b5d8-913965398182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:41.643490 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3fa02c-7d7e-442f-b5d8-913965398182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1042228937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=12f1677c-6a0c-463c-a2a3-e0dc20bab9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98fc977ca1e415aa56d63e901a9acaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:07:42Z,use_quota=True,user_id='d09873cd5b94494a82b44cd5a3920dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:41.649688 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48e65b4-9bb4-4644-ba5a-f4aaacff882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:41.654344 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48e65b4-9bb4-4644-ba5a-f4aaacff882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:41.659547 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63461543-d8af-4a0e-982c-4befa610b91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:41.663479 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63461543-d8af-4a0e-982c-4befa610b91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f1677c-6a0c-463c-a2a3-e0dc20bab9bd', 'volume_name': 'volume-12f1677c-6a0c-463c-a2a3-e0dc20bab9bd', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:41.668419 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa93b158-bb42-4fbf-a18a-71861f025f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:41.672482 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa93b158-bb42-4fbf-a18a-71861f025f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:41.699293 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbbe8b40-49fc-447d-b1f1-3c97ed7b827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:41.700418 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Volume 12f1677c-6a0c-463c-a2a3-e0dc20bab9bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f1677c-6a0c-463c-a2a3-e0dc20bab9bd', 'volume_size': 1} Jun 04 21:07:41.700974 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] creating volume 'volume-12f1677c-6a0c-463c-a2a3-e0dc20bab9bd' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:07:41.701725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:41.800603 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:07:41.802184 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:07:41.808821 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbbe8b40-49fc-447d-b1f1-3c97ed7b827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f1677c-6a0c-463c-a2a3-e0dc20bab9bd', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:41.822186 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b35ebb0-d1c0-4972-94aa-ec730a462365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:41.846509 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Volume volume-12f1677c-6a0c-463c-a2a3-e0dc20bab9bd (12f1677c-6a0c-463c-a2a3-e0dc20bab9bd): created successfully Jun 04 21:07:41.851399 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b35ebb0-d1c0-4972-94aa-ec730a462365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:41.870122 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Flow 'volume_create_manager' (348d2571-8f15-4fe6-a6da-dd2d9e65d5ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:41.876772 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=62,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:41.878153 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:07:41.920131 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] deleting parent snapshot volume-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:07:42.699709 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3678dc85-3237-46ae-b2f8-88b1648a2274 tempest-VolumesListAdminTestJSON-496465563 None] Created volume successfully. Jun 04 21:07:42.741972 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] Created reservations ['f65c8f5e-5462-491c-b08f-afce8702a5d6', 'a271c466-cc26-4fb4-bbcf-71be715ef3bd', '7aab89c7-d6b8-4451-8c7d-296b188348be', '05fb6cb1-248d-4d21-91cb-7da4399db9fe'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:42.837581 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:42.913984 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:42.986359 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:07:42.992195 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] Deleted volume successfully. Jun 04 21:07:43.024256 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3bd9a8b8-40ee-4c1b-acd8-89f0f0a39cd5 tempest-TaggedBootDevicesTest-1959467912 None] Lock "b'cinder-8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d-delete_volume'" released by "delete_volume" :: held 1.972s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:43.532328 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:07:43.593405 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Flow 'volume_create_manager' (7b8e2247-4ffc-44b5-a863-549ef25c317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:43.603115 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcf01c9-4b9b-4cdd-a3df-092c557f4df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:43.625807 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcf01c9-4b9b-4cdd-a3df-092c557f4df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1254308791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=250571d7-1251-4d3b-9ac6-9ff602f3c9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98fc977ca1e415aa56d63e901a9acaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:07:43Z,use_quota=True,user_id='d09873cd5b94494a82b44cd5a3920dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:43.632871 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0fdbef7-e040-44c2-a661-a0f37861abdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:43.639488 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0fdbef7-e040-44c2-a661-a0f37861abdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:43.644964 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b42441-2a47-4923-bd4b-83bb833c076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:43.651013 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b42441-2a47-4923-bd4b-83bb833c076c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '250571d7-1251-4d3b-9ac6-9ff602f3c9d3', 'volume_name': 'volume-250571d7-1251-4d3b-9ac6-9ff602f3c9d3', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:43.659811 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9715a8de-4a63-4d09-b22c-b9c72768499e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:43.664767 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9715a8de-4a63-4d09-b22c-b9c72768499e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:43.674211 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de7a1e8-df68-4b7e-9319-3114759b2bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:43.675569 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Volume 250571d7-1251-4d3b-9ac6-9ff602f3c9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-250571d7-1251-4d3b-9ac6-9ff602f3c9d3', 'volume_size': 1} Jun 04 21:07:43.676125 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] creating volume 'volume-250571d7-1251-4d3b-9ac6-9ff602f3c9d3' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:07:43.677407 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:43.808847 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:07:43.809479 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:07:43.814575 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de7a1e8-df68-4b7e-9319-3114759b2bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-250571d7-1251-4d3b-9ac6-9ff602f3c9d3', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:43.825262 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dec0305-6df4-4e02-898c-7b5ae7fa66be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:43.850978 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Volume volume-250571d7-1251-4d3b-9ac6-9ff602f3c9d3 (250571d7-1251-4d3b-9ac6-9ff602f3c9d3): created successfully Jun 04 21:07:43.866381 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dec0305-6df4-4e02-898c-7b5ae7fa66be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:43.877191 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Flow 'volume_create_manager' (7b8e2247-4ffc-44b5-a863-549ef25c317b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:43.900523 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-620f528d-f3b6-45e9-a45a-7972310b24ce tempest-VolumesListAdminTestJSON-496465563 None] Created volume successfully. Jun 04 21:07:45.334719 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:07:45.336088 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:45.438532 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:45.549675 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:07:45.589289 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:07:45.640616 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Flow 'volume_create_manager' (4713f5bd-a4d8-4bf6-86af-4ec17153012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:45.650033 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92775b54-88f0-4540-8634-8d123d3cbf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:45.674913 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92775b54-88f0-4540-8634-8d123d3cbf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=13c87b19-1607-4423-be92-df1df423483d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a798a42e9191470789815fe0f1ae0fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:07:45Z,use_quota=True,user_id='0dc6e2f7c18b4505a524b44873ce778b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:45.683646 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd10594-94e1-4159-a546-22c6a8a6d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:45.690524 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd10594-94e1-4159-a546-22c6a8a6d48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:45.700805 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4351c303-4500-46be-a1a4-4c2cf63b8acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:45.707042 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4351c303-4500-46be-a1a4-4c2cf63b8acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c87b19-1607-4423-be92-df1df423483d', 'volume_name': 'volume-13c87b19-1607-4423-be92-df1df423483d', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:45.712895 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7435c20a-11df-4f6f-9a29-1cca6710ecfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:45.719060 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7435c20a-11df-4f6f-9a29-1cca6710ecfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:45.726092 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a6ac5a-e3a8-4673-aa24-1da97b91919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:45.727614 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Volume 13c87b19-1607-4423-be92-df1df423483d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c87b19-1607-4423-be92-df1df423483d', 'volume_size': 1} Jun 04 21:07:45.728386 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] creating volume 'volume-13c87b19-1607-4423-be92-df1df423483d' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:07:45.729292 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:45.880894 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:07:45.881396 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:07:45.885888 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a6ac5a-e3a8-4673-aa24-1da97b91919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c87b19-1607-4423-be92-df1df423483d', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:45.896115 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4f12bf-69e1-46f0-bb72-2978f7f0d099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:07:45.929583 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Volume volume-13c87b19-1607-4423-be92-df1df423483d (13c87b19-1607-4423-be92-df1df423483d): created successfully Jun 04 21:07:45.934111 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4f12bf-69e1-46f0-bb72-2978f7f0d099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:07:45.945007 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Flow 'volume_create_manager' (4713f5bd-a4d8-4bf6-86af-4ec17153012c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:07:45.969464 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-460576af-e676-442c-a64c-65afc5273e7e tempest-VolumesListAdminTestJSON-507304792 None] Created volume successfully. Jun 04 21:07:46.681533 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-e303f626-ada6-43a8-b822-843e118e21bf tempest-VolumesListAdminTestJSON-507304792 None] Lock "b'cinder-13c87b19-1607-4423-be92-df1df423483d-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:46.742586 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e303f626-ada6-43a8-b822-843e118e21bf tempest-VolumesListAdminTestJSON-507304792 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:46.867312 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e303f626-ada6-43a8-b822-843e118e21bf tempest-VolumesListAdminTestJSON-507304792 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:07:46.867782 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e303f626-ada6-43a8-b822-843e118e21bf tempest-VolumesListAdminTestJSON-507304792 None] Volume volume-13c87b19-1607-4423-be92-df1df423483d is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:07:46.876877 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e303f626-ada6-43a8-b822-843e118e21bf tempest-VolumesListAdminTestJSON-507304792 None] deleting rbd volume volume-13c87b19-1607-4423-be92-df1df423483d {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:07:46.912094 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ef54c94f-2bd1-4d21-a8d6-650b9078be39 tempest-VolumesListAdminTestJSON-496465563 None] Lock "b'cinder-250571d7-1251-4d3b-9ac6-9ff602f3c9d3-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:46.968418 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ef54c94f-2bd1-4d21-a8d6-650b9078be39 tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:47.032946 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ef54c94f-2bd1-4d21-a8d6-650b9078be39 tempest-VolumesListAdminTestJSON-496465563 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:07:47.033491 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ef54c94f-2bd1-4d21-a8d6-650b9078be39 tempest-VolumesListAdminTestJSON-496465563 None] Volume volume-250571d7-1251-4d3b-9ac6-9ff602f3c9d3 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:07:47.045315 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ef54c94f-2bd1-4d21-a8d6-650b9078be39 tempest-VolumesListAdminTestJSON-496465563 None] deleting rbd volume volume-250571d7-1251-4d3b-9ac6-9ff602f3c9d3 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:07:47.642079 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-e303f626-ada6-43a8-b822-843e118e21bf tempest-VolumesListAdminTestJSON-507304792 None] Created reservations ['dafa4e50-a11f-4ef7-a251-bb634881294b', '1adada44-c314-4af7-a4df-2a9c0cebd886', '9866e8d9-6d13-41bc-974b-eadabedbf7b6', 'f4611567-8336-4451-9c4d-dbd55d7ba027'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:47.720109 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e303f626-ada6-43a8-b822-843e118e21bf tempest-VolumesListAdminTestJSON-507304792 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:47.794929 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e303f626-ada6-43a8-b822-843e118e21bf tempest-VolumesListAdminTestJSON-507304792 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:47.879067 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-e303f626-ada6-43a8-b822-843e118e21bf tempest-VolumesListAdminTestJSON-507304792 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:07:47.908006 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e303f626-ada6-43a8-b822-843e118e21bf tempest-VolumesListAdminTestJSON-507304792 None] Deleted volume successfully. Jun 04 21:07:47.976634 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-e303f626-ada6-43a8-b822-843e118e21bf tempest-VolumesListAdminTestJSON-507304792 None] Lock "b'cinder-13c87b19-1607-4423-be92-df1df423483d-delete_volume'" released by "delete_volume" :: held 1.295s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:48.031454 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-ef54c94f-2bd1-4d21-a8d6-650b9078be39 tempest-VolumesListAdminTestJSON-496465563 None] Created reservations ['96146c48-6048-4324-88bf-a29111862bd6', '01871183-a3a2-4417-8ac7-11fcb6bdec1b', 'f713b4f5-3739-4e52-b67b-42960f95c028', '5c5e691b-fc91-47c6-88f8-3594fbca408c'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:48.035095 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=61,cinder:INSERT=8,cinder:UPDATE=27,cinder:DELETE=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:48.112745 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ef54c94f-2bd1-4d21-a8d6-650b9078be39 tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:48.172540 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ef54c94f-2bd1-4d21-a8d6-650b9078be39 tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:48.240464 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-ef54c94f-2bd1-4d21-a8d6-650b9078be39 tempest-VolumesListAdminTestJSON-496465563 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:07:48.246499 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ef54c94f-2bd1-4d21-a8d6-650b9078be39 tempest-VolumesListAdminTestJSON-496465563 None] Deleted volume successfully. Jun 04 21:07:48.284983 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ef54c94f-2bd1-4d21-a8d6-650b9078be39 tempest-VolumesListAdminTestJSON-496465563 None] Lock "b'cinder-250571d7-1251-4d3b-9ac6-9ff602f3c9d3-delete_volume'" released by "delete_volume" :: held 1.374s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:49.142586 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ac1677c3-4c9a-4d8e-a72e-e574d9e730f8 tempest-VolumesListAdminTestJSON-496465563 None] Lock "b'cinder-12f1677c-6a0c-463c-a2a3-e0dc20bab9bd-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:49.225476 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ac1677c3-4c9a-4d8e-a72e-e574d9e730f8 tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:49.327347 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ac1677c3-4c9a-4d8e-a72e-e574d9e730f8 tempest-VolumesListAdminTestJSON-496465563 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:07:49.327868 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ac1677c3-4c9a-4d8e-a72e-e574d9e730f8 tempest-VolumesListAdminTestJSON-496465563 None] Volume volume-12f1677c-6a0c-463c-a2a3-e0dc20bab9bd is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:07:49.343189 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ac1677c3-4c9a-4d8e-a72e-e574d9e730f8 tempest-VolumesListAdminTestJSON-496465563 None] deleting rbd volume volume-12f1677c-6a0c-463c-a2a3-e0dc20bab9bd {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:07:49.873343 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-ac1677c3-4c9a-4d8e-a72e-e574d9e730f8 tempest-VolumesListAdminTestJSON-496465563 None] Created reservations ['47c0810a-8546-46db-b99e-1b7e0cf1ae46', '907c2453-8482-4de5-a840-5b8ad795d868', 'd6458b86-1154-434c-90aa-a43c928a9c38', '1e92341c-d350-42bf-abcb-04fca550770f'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:49.971710 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ac1677c3-4c9a-4d8e-a72e-e574d9e730f8 tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:50.047869 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ac1677c3-4c9a-4d8e-a72e-e574d9e730f8 tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:50.174350 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-ac1677c3-4c9a-4d8e-a72e-e574d9e730f8 tempest-VolumesListAdminTestJSON-496465563 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:07:50.184079 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ac1677c3-4c9a-4d8e-a72e-e574d9e730f8 tempest-VolumesListAdminTestJSON-496465563 None] Deleted volume successfully. Jun 04 21:07:50.202800 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ac1677c3-4c9a-4d8e-a72e-e574d9e730f8 tempest-VolumesListAdminTestJSON-496465563 None] Lock "b'cinder-12f1677c-6a0c-463c-a2a3-e0dc20bab9bd-delete_volume'" released by "delete_volume" :: held 1.076s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:07:50.449059 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-38a0eacc-4418-4c1e-91db-dbc4e17c2074 tempest-VolumesListAdminTestJSON-496465563 None] Lock "b'cinder-ae3f86e6-2bca-4e03-9357-b20d0883f893-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:07:50.554128 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-38a0eacc-4418-4c1e-91db-dbc4e17c2074 tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:50.655094 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-38a0eacc-4418-4c1e-91db-dbc4e17c2074 tempest-VolumesListAdminTestJSON-496465563 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:07:50.655544 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-38a0eacc-4418-4c1e-91db-dbc4e17c2074 tempest-VolumesListAdminTestJSON-496465563 None] Volume volume-ae3f86e6-2bca-4e03-9357-b20d0883f893 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:07:50.672875 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-38a0eacc-4418-4c1e-91db-dbc4e17c2074 tempest-VolumesListAdminTestJSON-496465563 None] deleting rbd volume volume-ae3f86e6-2bca-4e03-9357-b20d0883f893 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:07:51.414100 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=33,cinder:SELECT=55,cinder:DELETE=2,cinder:INSERT=10 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:51.458005 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-38a0eacc-4418-4c1e-91db-dbc4e17c2074 tempest-VolumesListAdminTestJSON-496465563 None] Created reservations ['84f226a5-0b0a-4dd7-9113-cb690ea73608', 'b31e8a75-5b9e-4e5b-961c-631c6975dbf3', 'fd2ed3df-bc3c-4afd-a560-9e67727c60f9', 'b72d2f27-de13-4807-9d19-043c787d4c3a'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:07:51.585474 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-38a0eacc-4418-4c1e-91db-dbc4e17c2074 tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:51.643484 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-38a0eacc-4418-4c1e-91db-dbc4e17c2074 tempest-VolumesListAdminTestJSON-496465563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:07:51.726988 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-38a0eacc-4418-4c1e-91db-dbc4e17c2074 tempest-VolumesListAdminTestJSON-496465563 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:07:51.733810 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-38a0eacc-4418-4c1e-91db-dbc4e17c2074 tempest-VolumesListAdminTestJSON-496465563 None] Deleted volume successfully. Jun 04 21:07:51.777059 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-38a0eacc-4418-4c1e-91db-dbc4e17c2074 tempest-VolumesListAdminTestJSON-496465563 None] Lock "b'cinder-ae3f86e6-2bca-4e03-9357-b20d0883f893-delete_volume'" released by "delete_volume" :: held 1.328s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:08:01.740215 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:03.745512 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:08:03.815769 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Flow 'volume_create_manager' (df33b55f-2207-4672-8745-022d49b5e75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:03.860506 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f24eb6-cacf-4f5f-975f-6d25d00d2280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:03.907683 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f24eb6-cacf-4f5f-975f-6d25d00d2280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-655283179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=30c986a7-5179-4ca6-af9b-53fcf06b6ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72307bb0ec24d91a632a33d7b6fe327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:08:04Z,use_quota=True,user_id='a724241c1a654f5191565cf93dd7a0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:03.915806 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd06490-ac90-463c-9221-aab444890506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:03.924731 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd06490-ac90-463c-9221-aab444890506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:03.932946 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a19ffc6-5e7a-4c6b-828a-d17d73ba6e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:03.937462 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a19ffc6-5e7a-4c6b-828a-d17d73ba6e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c986a7-5179-4ca6-af9b-53fcf06b6ae4', 'volume_name': 'volume-30c986a7-5179-4ca6-af9b-53fcf06b6ae4', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:03.942466 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44e681e-e94e-48f7-9dd2-fdbb1a3989eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:03.946850 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44e681e-e94e-48f7-9dd2-fdbb1a3989eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:03.952194 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020cc0e5-646d-47cb-9b76-daec6a56fa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:03.954056 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Volume 30c986a7-5179-4ca6-af9b-53fcf06b6ae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c986a7-5179-4ca6-af9b-53fcf06b6ae4', 'volume_size': 1} Jun 04 21:08:03.954664 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] creating volume 'volume-30c986a7-5179-4ca6-af9b-53fcf06b6ae4' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:08:03.955805 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:04.110370 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:08:04.110852 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:08:04.117579 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020cc0e5-646d-47cb-9b76-daec6a56fa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c986a7-5179-4ca6-af9b-53fcf06b6ae4', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:04.126879 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30f7b68-c240-4c2e-b3ac-37ac50601bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:04.151376 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Volume volume-30c986a7-5179-4ca6-af9b-53fcf06b6ae4 (30c986a7-5179-4ca6-af9b-53fcf06b6ae4): created successfully Jun 04 21:08:04.155804 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30f7b68-c240-4c2e-b3ac-37ac50601bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:04.168130 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Flow 'volume_create_manager' (df33b55f-2207-4672-8745-022d49b5e75e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:04.209126 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-33aebf47-0331-453c-bb4a-5f48ec284160 tempest-SnapshotMetadataTestJSON-1897119350 None] Created volume successfully. Jun 04 21:08:05.128725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f8ac972b-8423-4c5d-afe4-7887f032d854 tempest-SnapshotMetadataTestJSON-1897119350 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:05.748907 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f8ac972b-8423-4c5d-afe4-7887f032d854 tempest-SnapshotMetadataTestJSON-1897119350 None] Create snapshot completed successfully Jun 04 21:08:07.632745 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-a1594623-b16c-4ffc-9926-eacabd235a1c tempest-SnapshotMetadataTestJSON-1897119350 None] Lock "b'cinder-61bbca33-1055-4857-a506-0f08fde906b0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:08:07.634859 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a1594623-b16c-4ffc-9926-eacabd235a1c tempest-SnapshotMetadataTestJSON-1897119350 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:08.798601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-a1594623-b16c-4ffc-9926-eacabd235a1c tempest-SnapshotMetadataTestJSON-1897119350 None] Created reservations ['94afa9e6-5fc5-4b98-aa0d-41c3490a3720', '7d6f8ce2-c458-4260-9e70-f51343e7c472', '7e1370ff-2cd6-408a-8cc2-712958e4f3fd', '58d71ac7-9446-48c7-82ba-84a5db4e7d6d'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:08:08.886676 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a1594623-b16c-4ffc-9926-eacabd235a1c tempest-SnapshotMetadataTestJSON-1897119350 None] Delete snapshot completed successfully. Jun 04 21:08:08.901351 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-a1594623-b16c-4ffc-9926-eacabd235a1c tempest-SnapshotMetadataTestJSON-1897119350 None] Lock "b'cinder-61bbca33-1055-4857-a506-0f08fde906b0-delete_snapshot'" released by "delete_snapshot" :: held 1.269s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:08:09.818367 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3b2ae43e-b94a-4f78-a0aa-3aa38781ee67 tempest-SnapshotMetadataTestJSON-1897119350 None] Lock "b'cinder-30c986a7-5179-4ca6-af9b-53fcf06b6ae4-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:08:09.911954 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3b2ae43e-b94a-4f78-a0aa-3aa38781ee67 tempest-SnapshotMetadataTestJSON-1897119350 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:09.988712 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3b2ae43e-b94a-4f78-a0aa-3aa38781ee67 tempest-SnapshotMetadataTestJSON-1897119350 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:08:09.989423 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3b2ae43e-b94a-4f78-a0aa-3aa38781ee67 tempest-SnapshotMetadataTestJSON-1897119350 None] Volume volume-30c986a7-5179-4ca6-af9b-53fcf06b6ae4 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:08:09.996030 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3b2ae43e-b94a-4f78-a0aa-3aa38781ee67 tempest-SnapshotMetadataTestJSON-1897119350 None] deleting rbd volume volume-30c986a7-5179-4ca6-af9b-53fcf06b6ae4 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:08:10.293023 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=34,cinder:SELECT=58,cinder:DELETE=2,cinder:INSERT=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:10.298727 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-3b2ae43e-b94a-4f78-a0aa-3aa38781ee67 tempest-SnapshotMetadataTestJSON-1897119350 None] Created reservations ['0ef611f7-7a55-4d04-b2de-1c80f5f4ff7b', '34b11f27-e39c-4e02-8ff6-477ce3b32071', '374906f7-7802-4911-916b-dfb53c21a90d', '1e7a59c5-0ca6-4d9a-b63f-fdb0b3a77f95'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:08:10.366449 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3b2ae43e-b94a-4f78-a0aa-3aa38781ee67 tempest-SnapshotMetadataTestJSON-1897119350 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:10.435968 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3b2ae43e-b94a-4f78-a0aa-3aa38781ee67 tempest-SnapshotMetadataTestJSON-1897119350 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:10.512500 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-3b2ae43e-b94a-4f78-a0aa-3aa38781ee67 tempest-SnapshotMetadataTestJSON-1897119350 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:08:10.517888 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3b2ae43e-b94a-4f78-a0aa-3aa38781ee67 tempest-SnapshotMetadataTestJSON-1897119350 None] Deleted volume successfully. Jun 04 21:08:10.537839 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3b2ae43e-b94a-4f78-a0aa-3aa38781ee67 tempest-SnapshotMetadataTestJSON-1897119350 None] Lock "b'cinder-30c986a7-5179-4ca6-af9b-53fcf06b6ae4-delete_volume'" released by "delete_volume" :: held 0.721s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:08:15.488059 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:08:15.519121 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Flow 'volume_create_manager' (fbc7bb99-edf1-4d7e-9470-a86717b52507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:15.533554 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee8170c-f17d-4210-9f84-2ae7e0c2943a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:15.565918 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee8170c-f17d-4210-9f84-2ae7e0c2943a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-500005982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c836df33-8fb7-44c0-b929-30e858c8f700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78708ead8abd482bab61be479bae7912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:08:15Z,use_quota=True,user_id='14f03605fadb4a819444a497e7a2805f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:15.572406 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15dab774-5152-4a7d-8f50-5fbc1fa9489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:15.580756 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15dab774-5152-4a7d-8f50-5fbc1fa9489b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:15.607790 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bfff5b-060a-46d0-81c2-8cee1b72e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:15.627222 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bfff5b-060a-46d0-81c2-8cee1b72e867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c836df33-8fb7-44c0-b929-30e858c8f700', 'volume_name': 'volume-c836df33-8fb7-44c0-b929-30e858c8f700', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:15.633978 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2852db-5642-41a5-8760-66f478f95a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:15.643993 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2852db-5642-41a5-8760-66f478f95a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:15.660482 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7fb3742-e19f-4c11-b26e-253380a480d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:15.662570 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Volume c836df33-8fb7-44c0-b929-30e858c8f700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c836df33-8fb7-44c0-b929-30e858c8f700', 'volume_size': 1} Jun 04 21:08:15.663129 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] creating volume 'volume-c836df33-8fb7-44c0-b929-30e858c8f700' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:08:15.664123 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:15.850014 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:08:15.850693 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:08:15.856724 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7fb3742-e19f-4c11-b26e-253380a480d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c836df33-8fb7-44c0-b929-30e858c8f700', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:15.868593 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baabc242-2e9d-46d8-95d9-1ae8b70b16f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:15.909049 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Volume volume-c836df33-8fb7-44c0-b929-30e858c8f700 (c836df33-8fb7-44c0-b929-30e858c8f700): created successfully Jun 04 21:08:15.913329 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baabc242-2e9d-46d8-95d9-1ae8b70b16f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:15.922192 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Flow 'volume_create_manager' (fbc7bb99-edf1-4d7e-9470-a86717b52507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:15.955583 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-687cecd6-491e-4399-b56a-ce740cba1d75 tempest-VolumesBackupsTest-1343716541 None] Created volume successfully. Jun 04 21:08:23.901204 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:08:23.923645 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Flow 'volume_create_manager' (1b6082c3-8442-43c7-964c-a3c1e2cd36f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:23.934188 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066c12d4-bf31-440d-ba2a-476088a44825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:23.956513 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066c12d4-bf31-440d-ba2a-476088a44825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1575473819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8abf73775cf4d25aec54d7e27a6cc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:08:24Z,use_quota=True,user_id='60df515b9c4c490994284bf20ccb0b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:23.963887 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988e0af1-e117-449e-ba97-a7f9fe250b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:23.970157 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988e0af1-e117-449e-ba97-a7f9fe250b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:23.976376 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d312a681-ffce-4e27-9f6b-ca8f4b4e9cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:23.981489 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d312a681-ffce-4e27-9f6b-ca8f4b4e9cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8', 'volume_name': 'volume-194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:23.987726 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4673cc11-6317-4101-9ac4-a526972ed728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:23.992665 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4673cc11-6317-4101-9ac4-a526972ed728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:23.998254 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b5e34e-9c22-48d9-ac5c-bb16c395ea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:23.999715 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8', 'volume_size': 1} Jun 04 21:08:24.000331 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] creating volume 'volume-194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:08:24.001181 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:24.152587 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:08:24.153647 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:08:24.162800 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b5e34e-9c22-48d9-ac5c-bb16c395ea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:24.171125 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1ba6fa-66a1-4f6b-9086-c61f64c72290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:24.189010 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Volume volume-194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 (194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8): created successfully Jun 04 21:08:24.194887 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1ba6fa-66a1-4f6b-9086-c61f64c72290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:24.210306 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Flow 'volume_create_manager' (1b6082c3-8442-43c7-964c-a3c1e2cd36f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:24.243289 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 req-5a47aa7b-82a5-4b85-bb2a-2da48bec7421 tempest-VolumesSnapshotsTestJSON-564982919 None] Created volume successfully. Jun 04 21:08:25.638836 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-5e60d795-2d62-4f17-8461-eaffeedf58be req-b2bfb000-0202-471d-8185-f09e135e9a7f tempest-VolumesSnapshotsTestJSON-564982919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:26.816755 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-5e60d795-2d62-4f17-8461-eaffeedf58be req-b2bfb000-0202-471d-8185-f09e135e9a7f tempest-VolumesSnapshotsTestJSON-564982919 None] Create snapshot completed successfully Jun 04 21:08:27.314825 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-b9796b8b-19f8-4f96-be8f-950b0d1fe36b req-95c7cbb5-95f1-4e3c-a1b9-1a3fda277560 tempest-VolumesSnapshotsTestJSON-564982919 None] Lock "b'cinder-841b81bc-280d-455e-9b47-871a86c8ae55-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.049s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:08:27.318142 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-b9796b8b-19f8-4f96-be8f-950b0d1fe36b req-95c7cbb5-95f1-4e3c-a1b9-1a3fda277560 tempest-VolumesSnapshotsTestJSON-564982919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:27.920760 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=57,cinder:UPDATE=32,cinder:DELETE=5,cinder:INSERT=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:27.989348 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [req-b9796b8b-19f8-4f96-be8f-950b0d1fe36b req-95c7cbb5-95f1-4e3c-a1b9-1a3fda277560 tempest-VolumesSnapshotsTestJSON-564982919 None] Created reservations ['d0aae940-18f7-44f4-a77b-bea6f2ddde9f', 'd9fdabc8-8b7c-44b3-bf74-bd33106dfb25', '5f712a52-0947-4ee4-a03b-58d054c27b95', '964bc42a-b5b2-4aef-b055-793abf93ac0f'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:08:28.115420 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-b9796b8b-19f8-4f96-be8f-950b0d1fe36b req-95c7cbb5-95f1-4e3c-a1b9-1a3fda277560 tempest-VolumesSnapshotsTestJSON-564982919 None] Delete snapshot completed successfully. Jun 04 21:08:28.121844 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-b9796b8b-19f8-4f96-be8f-950b0d1fe36b req-95c7cbb5-95f1-4e3c-a1b9-1a3fda277560 tempest-VolumesSnapshotsTestJSON-564982919 None] Lock "b'cinder-841b81bc-280d-455e-9b47-871a86c8ae55-delete_snapshot'" released by "delete_snapshot" :: held 0.808s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:08:29.215525 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-2e354efe-b41e-4b5f-a16f-e048a5809455 req-2a20b195-a516-4b68-9698-48ef6f965011 tempest-VolumesSnapshotsTestJSON-564982919 None] Lock "b'cinder-194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:08:29.349006 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-2e354efe-b41e-4b5f-a16f-e048a5809455 req-2a20b195-a516-4b68-9698-48ef6f965011 tempest-VolumesSnapshotsTestJSON-564982919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:29.485238 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-2e354efe-b41e-4b5f-a16f-e048a5809455 req-2a20b195-a516-4b68-9698-48ef6f965011 tempest-VolumesSnapshotsTestJSON-564982919 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:08:29.485690 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-2e354efe-b41e-4b5f-a16f-e048a5809455 req-2a20b195-a516-4b68-9698-48ef6f965011 tempest-VolumesSnapshotsTestJSON-564982919 None] Volume volume-194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:08:29.505497 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-2e354efe-b41e-4b5f-a16f-e048a5809455 req-2a20b195-a516-4b68-9698-48ef6f965011 tempest-VolumesSnapshotsTestJSON-564982919 None] deleting rbd volume volume-194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:08:30.175345 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [req-2e354efe-b41e-4b5f-a16f-e048a5809455 req-2a20b195-a516-4b68-9698-48ef6f965011 tempest-VolumesSnapshotsTestJSON-564982919 None] Created reservations ['2140402a-83a2-4fd8-b283-7ee9f6ecd85b', 'c898927b-f977-46a5-83e2-bc8f0b0d4d20', 'ba104ac2-cdac-48f8-96b7-f3503c21c835', 'e6dce555-9d1b-4234-9520-a7ad505f64c6'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:08:30.356330 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-2e354efe-b41e-4b5f-a16f-e048a5809455 req-2a20b195-a516-4b68-9698-48ef6f965011 tempest-VolumesSnapshotsTestJSON-564982919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:30.416024 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-2e354efe-b41e-4b5f-a16f-e048a5809455 req-2a20b195-a516-4b68-9698-48ef6f965011 tempest-VolumesSnapshotsTestJSON-564982919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:30.495824 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [req-2e354efe-b41e-4b5f-a16f-e048a5809455 req-2a20b195-a516-4b68-9698-48ef6f965011 tempest-VolumesSnapshotsTestJSON-564982919 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:08:30.504260 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-2e354efe-b41e-4b5f-a16f-e048a5809455 req-2a20b195-a516-4b68-9698-48ef6f965011 tempest-VolumesSnapshotsTestJSON-564982919 None] Deleted volume successfully. Jun 04 21:08:30.533924 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-2e354efe-b41e-4b5f-a16f-e048a5809455 req-2a20b195-a516-4b68-9698-48ef6f965011 tempest-VolumesSnapshotsTestJSON-564982919 None] Lock "b'cinder-194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8-delete_volume'" released by "delete_volume" :: held 1.318s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:08:34.440277 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-5d1db252-9075-4963-8e8f-9eb0733eb9ef req-8b94de45-34b2-43f4-96b9-be3d17e56313 tempest-AttachVolumeTestJSON-1210396921 None] Terminate volume connection completed successfully. Jun 04 21:08:34.440954 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-5d1db252-9075-4963-8e8f-9eb0733eb9ef req-8b94de45-34b2-43f4-96b9-be3d17e56313 tempest-AttachVolumeTestJSON-1210396921 None] Deleting attachment 3bdc1433-7b69-4d9f-a901-3988776854ee. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:08:44.542003 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=43,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=8 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:45.334580 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:08:45.335279 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:45.438315 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:45.543860 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:08:45.623730 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:08:45.672004 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Flow 'volume_create_manager' (d060d47b-8162-468d-ab50-fcc06f09b92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:45.685672 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6d99d4-dd35-4ee3-81b0-6b80cdd613a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:45.731594 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6d99d4-dd35-4ee3-81b0-6b80cdd613a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1908894879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0759769d-5fc7-469e-af57-4709d45e102f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a41aa195bb047cfae9f16c5e29050cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:08:45Z,use_quota=True,user_id='33de20254305474aa55173591da1b6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:45.737221 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e996311-dadc-408e-9bf9-906850564903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:45.745741 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e996311-dadc-408e-9bf9-906850564903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:45.755783 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267a58d0-f999-40c6-8d8e-c5451ed67093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:45.945079 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267a58d0-f999-40c6-8d8e-c5451ed67093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0759769d-5fc7-469e-af57-4709d45e102f', 'volume_name': 'volume-0759769d-5fc7-469e-af57-4709d45e102f', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:45.952601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc5c26f-746d-4c66-907b-b49ef0d426ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:45.959157 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc5c26f-746d-4c66-907b-b49ef0d426ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:45.966151 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66d3ba7-af73-4ed2-8e22-a671f4db9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:45.968721 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Volume 0759769d-5fc7-469e-af57-4709d45e102f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0759769d-5fc7-469e-af57-4709d45e102f', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:08:45.970186 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Cloning 0759769d-5fc7-469e-af57-4709d45e102f from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:08:46.009991 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.033s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:08:46.030310 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 8, 46, 12786)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:08:46.031241 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:08:46.031833 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:08:46.039214 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.035s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:08:46.042296 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:08:46.059093 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 8, 46, 50023)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:08:46.059737 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:08:46.062115 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:08:46.093463 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:46.204566 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] creating snapshot='volume-0759769d-5fc7-469e-af57-4709d45e102f.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:08:46.779861 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-0759769d-5fc7-469e-af57-4709d45e102f.clone_snap' to 'volume-0759769d-5fc7-469e-af57-4709d45e102f' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:08:47.070928 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:08:47.072321 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:08:47.072948 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:08:47.121284 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:08:47.123003 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Marking volume 0759769d-5fc7-469e-af57-4709d45e102f as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:08:47.140906 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 0759769d-5fc7-469e-af57-4709d45e102f. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:08:47.141706 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Creating volume glance metadata for volume 0759769d-5fc7-469e-af57-4709d45e102f backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:08:47.285433 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66d3ba7-af73-4ed2-8e22-a671f4db9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0759769d-5fc7-469e-af57-4709d45e102f', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:47.302422 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de991de-3628-461b-abab-b23ebc2a46d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:47.320477 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Volume volume-0759769d-5fc7-469e-af57-4709d45e102f (0759769d-5fc7-469e-af57-4709d45e102f): created successfully Jun 04 21:08:47.326691 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de991de-3628-461b-abab-b23ebc2a46d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:47.348300 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Flow 'volume_create_manager' (d060d47b-8162-468d-ab50-fcc06f09b92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:47.396263 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-096f39e7-5e4f-4e90-a7d0-ee18f1de6aad tempest-TaggedBootDevicesTest_v242-575962399 None] Created volume successfully. Jun 04 21:08:48.419699 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:08:48.469698 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Flow 'volume_create_manager' (f2cda420-9547-4e7d-b482-d54085654836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:48.483594 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0e8889-8eb8-4519-98f3-9fe12aa72e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:48.532345 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0e8889-8eb8-4519-98f3-9fe12aa72e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-862464819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=66176986-39c7-4e62-9130-71c9355b1a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a41aa195bb047cfae9f16c5e29050cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:08:48Z,use_quota=True,user_id='33de20254305474aa55173591da1b6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:48.543999 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3505eeae-8ab5-43a2-a429-1f5535310ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:48.569828 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3505eeae-8ab5-43a2-a429-1f5535310ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:48.585401 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae234d95-1d10-4d70-bf75-3373dcf5b2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:48.590878 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae234d95-1d10-4d70-bf75-3373dcf5b2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66176986-39c7-4e62-9130-71c9355b1a92', 'volume_name': 'volume-66176986-39c7-4e62-9130-71c9355b1a92', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:48.597706 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ead97f9-3188-4d22-906d-9d8a1d727f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:48.606330 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ead97f9-3188-4d22-906d-9d8a1d727f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:48.613907 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b78b732-63a9-4350-b46b-50232536436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:48.618389 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Volume 66176986-39c7-4e62-9130-71c9355b1a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66176986-39c7-4e62-9130-71c9355b1a92', 'volume_size': 1} Jun 04 21:08:48.619028 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] creating volume 'volume-66176986-39c7-4e62-9130-71c9355b1a92' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:08:48.620039 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:48.774514 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:08:48.775169 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:08:48.779935 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b78b732-63a9-4350-b46b-50232536436a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66176986-39c7-4e62-9130-71c9355b1a92', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:48.796749 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8a2aee-41fe-460b-b867-b26ac5953a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:48.816189 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Volume volume-66176986-39c7-4e62-9130-71c9355b1a92 (66176986-39c7-4e62-9130-71c9355b1a92): created successfully Jun 04 21:08:48.820663 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8a2aee-41fe-460b-b867-b26ac5953a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:48.840116 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Flow 'volume_create_manager' (f2cda420-9547-4e7d-b482-d54085654836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:48.861566 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-6f9c970e-29fc-43d3-9594-35fb0a9a3f1c tempest-TaggedBootDevicesTest_v242-575962399 None] Created volume successfully. Jun 04 21:08:50.449419 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:08:50.594744 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Flow 'volume_create_manager' (16771502-be8c-493e-bd13-867c74d16f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:50.620470 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30effbba-4c35-4542-b3af-05dd3bf38e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:50.679082 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30effbba-4c35-4542-b3af-05dd3bf38e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1796470826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d16e3dd4-cd03-43cd-b2b9-c804951744fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a41aa195bb047cfae9f16c5e29050cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:08:50Z,use_quota=True,user_id='33de20254305474aa55173591da1b6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:50.689318 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7caf10ad-1ba9-4273-bc77-aa1d8359fc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:50.703370 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7caf10ad-1ba9-4273-bc77-aa1d8359fc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:50.715645 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e44409-a423-483f-819d-131fb5c16a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:50.736072 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e44409-a423-483f-819d-131fb5c16a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd16e3dd4-cd03-43cd-b2b9-c804951744fa', 'volume_name': 'volume-d16e3dd4-cd03-43cd-b2b9-c804951744fa', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:50.759386 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1818ea-5f42-4f84-a67d-c886ca6eea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:50.771842 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1818ea-5f42-4f84-a67d-c886ca6eea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:50.790035 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c0958c-156f-4f87-9385-61a2145f51ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:50.795261 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Volume d16e3dd4-cd03-43cd-b2b9-c804951744fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d16e3dd4-cd03-43cd-b2b9-c804951744fa', 'volume_size': 1} Jun 04 21:08:50.795722 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] creating volume 'volume-d16e3dd4-cd03-43cd-b2b9-c804951744fa' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:08:50.796377 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:08:50.895222 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 req-72c189e6-388d-4631-8fb9-244a23ec9d40 tempest-VolumesBackupsTest-1343716541 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:08:50.966238 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:08:50.966629 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:08:50.979360 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c0958c-156f-4f87-9385-61a2145f51ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d16e3dd4-cd03-43cd-b2b9-c804951744fa', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:50.998903 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da531877-bf01-439b-937b-a2e770d40e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:08:51.043664 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Volume volume-d16e3dd4-cd03-43cd-b2b9-c804951744fa (d16e3dd4-cd03-43cd-b2b9-c804951744fa): created successfully Jun 04 21:08:51.052892 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da531877-bf01-439b-937b-a2e770d40e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:08:51.072199 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Flow 'volume_create_manager' (16771502-be8c-493e-bd13-867c74d16f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:08:51.097406 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-693e07bc-d727-4869-8d75-a01cb521be0a tempest-TaggedBootDevicesTest_v242-575962399 None] Created volume successfully. Jun 04 21:08:52.625327 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 req-72c189e6-388d-4631-8fb9-244a23ec9d40 tempest-VolumesBackupsTest-1343716541 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.731s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:08:52.626269 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 req-72c189e6-388d-4631-8fb9-244a23ec9d40 tempest-VolumesBackupsTest-1343716541 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c836df33-8fb7-44c0-b929-30e858c8f700', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'c836df33-8fb7-44c0-b929-30e858c8f700', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:08:52.661404 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 req-72c189e6-388d-4631-8fb9-244a23ec9d40 tempest-VolumesBackupsTest-1343716541 None] Connection info returned from driver {'name': 'volumes/volume-c836df33-8fb7-44c0-b929-30e858c8f700', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c836df33-8fb7-44c0-b929-30e858c8f700', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '21ffe9ed-dcbb-4200-943e-2788be6f6a69'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:08:52.728603 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 req-72c189e6-388d-4631-8fb9-244a23ec9d40 tempest-VolumesBackupsTest-1343716541 None] attachment_update completed successfully. Jun 04 21:08:55.847851 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1b0d6674-5a47-4090-999e-5b2c54b4b0c3 tempest-VolumesBackupsTest-1343716541 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-04T21:08:55Z,data_timestamp=2022-06-04T21:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-2022810313',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=4c202e50-e87c-4202-a74e-5ecb7dc984a7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='78708ead8abd482bab61be479bae7912',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='14f03605fadb4a819444a497e7a2805f',volume_id=c836df33-8fb7-44c0-b929-30e858c8f700) Jun 04 21:08:55.858078 ncdv-master-1 cinder-volume[130490]: INFO cinder.rpc [None req-1b0d6674-5a47-4090-999e-5b2c54b4b0c3 tempest-VolumesBackupsTest-1343716541 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jun 04 21:08:55.866818 ncdv-master-1 cinder-volume[130490]: INFO cinder.rpc [None req-1b0d6674-5a47-4090-999e-5b2c54b4b0c3 tempest-VolumesBackupsTest-1343716541 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Jun 04 21:08:55.869392 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.backup.rpcapi [None req-1b0d6674-5a47-4090-999e-5b2c54b4b0c3 tempest-VolumesBackupsTest-1343716541 None] continue_backup in rpcapi backup_id 4c202e50-e87c-4202-a74e-5ecb7dc984a7 {{(pid=130490) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 04 21:09:04.449355 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-1b0d6674-5a47-4090-999e-5b2c54b4b0c3 tempest-VolumesBackupsTest-1343716541 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:09:04.587536 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=57,cinder:UPDATE=21,cinder:INSERT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:05.624635 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-1b0d6674-5a47-4090-999e-5b2c54b4b0c3 tempest-VolumesBackupsTest-1343716541 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.176s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:09:05.626265 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1b0d6674-5a47-4090-999e-5b2c54b4b0c3 tempest-VolumesBackupsTest-1343716541 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c836df33-8fb7-44c0-b929-30e858c8f700', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'c836df33-8fb7-44c0-b929-30e858c8f700', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:09:05.654839 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1b0d6674-5a47-4090-999e-5b2c54b4b0c3 tempest-VolumesBackupsTest-1343716541 None] Initialize volume connection completed successfully. Jun 04 21:09:10.147287 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1b0d6674-5a47-4090-999e-5b2c54b4b0c3 tempest-VolumesBackupsTest-1343716541 None] Terminate volume connection completed successfully. Jun 04 21:09:10.175772 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1b0d6674-5a47-4090-999e-5b2c54b4b0c3 tempest-VolumesBackupsTest-1343716541 None] Remove volume export completed successfully. Jun 04 21:09:13.948445 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-aba43da5-b381-4a8b-b02a-efd3ab790b76 req-2ef1e6d0-0a19-4050-8318-7813e089c3f4 tempest-VolumesBackupsTest-1343716541 None] Terminate volume connection completed successfully. Jun 04 21:09:13.949085 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-aba43da5-b381-4a8b-b02a-efd3ab790b76 req-2ef1e6d0-0a19-4050-8318-7813e089c3f4 tempest-VolumesBackupsTest-1343716541 None] Deleting attachment 21ffe9ed-dcbb-4200-943e-2788be6f6a69. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:09:14.242603 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-b6dd3630-fd12-4cd7-b59a-f270bb2223f7 tempest-TaggedBootDevicesTest_v242-575962399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:09:15.420762 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-b6dd3630-fd12-4cd7-b59a-f270bb2223f7 tempest-TaggedBootDevicesTest_v242-575962399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.178s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:09:15.421461 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-b6dd3630-fd12-4cd7-b59a-f270bb2223f7 tempest-TaggedBootDevicesTest_v242-575962399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0759769d-5fc7-469e-af57-4709d45e102f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '0759769d-5fc7-469e-af57-4709d45e102f', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:09:15.426706 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=54,cinder:UPDATE=9,cinder:INSERT=9,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:15.459338 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-b6dd3630-fd12-4cd7-b59a-f270bb2223f7 tempest-TaggedBootDevicesTest_v242-575962399 None] Connection info returned from driver {'name': 'volumes/volume-0759769d-5fc7-469e-af57-4709d45e102f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0759769d-5fc7-469e-af57-4709d45e102f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '272a056c-b6bd-4b8e-b46c-b296eff38490'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:09:15.533892 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-b6dd3630-fd12-4cd7-b59a-f270bb2223f7 tempest-TaggedBootDevicesTest_v242-575962399 None] attachment_update completed successfully. Jun 04 21:09:16.115899 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-b1aa63eb-4a0b-4123-bf37-7ee9d944bc77 tempest-TaggedBootDevicesTest_v242-575962399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:09:17.158899 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-b1aa63eb-4a0b-4123-bf37-7ee9d944bc77 tempest-TaggedBootDevicesTest_v242-575962399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.043s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:09:17.160163 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-b1aa63eb-4a0b-4123-bf37-7ee9d944bc77 tempest-TaggedBootDevicesTest_v242-575962399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-66176986-39c7-4e62-9130-71c9355b1a92', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '66176986-39c7-4e62-9130-71c9355b1a92', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:09:17.202379 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-b1aa63eb-4a0b-4123-bf37-7ee9d944bc77 tempest-TaggedBootDevicesTest_v242-575962399 None] Connection info returned from driver {'name': 'volumes/volume-66176986-39c7-4e62-9130-71c9355b1a92', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '66176986-39c7-4e62-9130-71c9355b1a92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '71e7fe43-23f0-47bc-9f61-c795194f985b'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:09:17.289275 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-b1aa63eb-4a0b-4123-bf37-7ee9d944bc77 tempest-TaggedBootDevicesTest_v242-575962399 None] attachment_update completed successfully. Jun 04 21:09:17.680892 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-5ff41170-3a17-499e-8cc7-4887e2ef30e2 tempest-TaggedBootDevicesTest_v242-575962399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:09:18.649405 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ea24a1d8-156e-49e6-a4c8-090b7e64169c tempest-VolumesBackupsTest-1343716541 None] Lock "b'cinder-c836df33-8fb7-44c0-b929-30e858c8f700-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:09:18.710054 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ea24a1d8-156e-49e6-a4c8-090b7e64169c tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:19.279788 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ea24a1d8-156e-49e6-a4c8-090b7e64169c tempest-VolumesBackupsTest-1343716541 None] Volume volume-c836df33-8fb7-44c0-b929-30e858c8f700 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:09:19.309891 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ea24a1d8-156e-49e6-a4c8-090b7e64169c tempest-VolumesBackupsTest-1343716541 None] deleting rbd volume volume-c836df33-8fb7-44c0-b929-30e858c8f700 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:09:19.312264 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-5ff41170-3a17-499e-8cc7-4887e2ef30e2 tempest-TaggedBootDevicesTest_v242-575962399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.632s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:09:19.327352 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-5ff41170-3a17-499e-8cc7-4887e2ef30e2 tempest-TaggedBootDevicesTest_v242-575962399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d16e3dd4-cd03-43cd-b2b9-c804951744fa', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'd16e3dd4-cd03-43cd-b2b9-c804951744fa', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:09:19.381540 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-5ff41170-3a17-499e-8cc7-4887e2ef30e2 tempest-TaggedBootDevicesTest_v242-575962399 None] Connection info returned from driver {'name': 'volumes/volume-d16e3dd4-cd03-43cd-b2b9-c804951744fa', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd16e3dd4-cd03-43cd-b2b9-c804951744fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '12270265-1ad1-4f55-8d62-724f2c2823cd'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:09:19.470367 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a req-5ff41170-3a17-499e-8cc7-4887e2ef30e2 tempest-TaggedBootDevicesTest_v242-575962399 None] attachment_update completed successfully. Jun 04 21:09:19.788461 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-ea24a1d8-156e-49e6-a4c8-090b7e64169c tempest-VolumesBackupsTest-1343716541 None] Created reservations ['3c6c68e2-bfa5-4635-9cca-4f25eafd3643', 'e9814334-2f47-495c-a6af-8921f3b02759', '47ba4bae-dad5-4e02-93a2-2beac7b53aeb', '748cb8b8-bafa-4e07-9bb5-c61681139377'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:09:19.878339 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ea24a1d8-156e-49e6-a4c8-090b7e64169c tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:19.939558 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ea24a1d8-156e-49e6-a4c8-090b7e64169c tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:20.000804 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-ea24a1d8-156e-49e6-a4c8-090b7e64169c tempest-VolumesBackupsTest-1343716541 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:09:20.008028 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ea24a1d8-156e-49e6-a4c8-090b7e64169c tempest-VolumesBackupsTest-1343716541 None] Deleted volume successfully. Jun 04 21:09:20.034708 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ea24a1d8-156e-49e6-a4c8-090b7e64169c tempest-VolumesBackupsTest-1343716541 None] Lock "b'cinder-c836df33-8fb7-44c0-b929-30e858c8f700-delete_volume'" released by "delete_volume" :: held 1.385s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:09:21.720554 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:09:21.754666 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Flow 'volume_create_manager' (e88f7733-1ac9-4acb-abb4-6a7f1e55bf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:09:21.762730 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc642f66-4c1b-4df1-900a-b45583a804f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:21.786559 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc642f66-4c1b-4df1-900a-b45583a804f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1388624036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c9bff0fd-4259-41d4-ab52-410890d15ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78708ead8abd482bab61be479bae7912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:09:22Z,use_quota=True,user_id='14f03605fadb4a819444a497e7a2805f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:21.795455 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d1a1a5-353a-4c1b-81c0-a5db636c8c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:21.800399 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d1a1a5-353a-4c1b-81c0-a5db636c8c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:21.806446 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f1c2b1-74e7-4d28-b0a1-32440044ad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:21.966823 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f1c2b1-74e7-4d28-b0a1-32440044ad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9bff0fd-4259-41d4-ab52-410890d15ed6', 'volume_name': 'volume-c9bff0fd-4259-41d4-ab52-410890d15ed6', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:21.979722 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7b5afe-1ab2-46c9-89eb-f13abeaebb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:21.985506 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7b5afe-1ab2-46c9-89eb-f13abeaebb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:21.994172 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0efd54-9434-4e8e-a4fc-9f180046f76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:21.996158 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Volume c9bff0fd-4259-41d4-ab52-410890d15ed6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9bff0fd-4259-41d4-ab52-410890d15ed6', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:09:21.997258 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Cloning c9bff0fd-4259-41d4-ab52-410890d15ed6 from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:09:22.017816 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:09:22.070503 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 9, 22, 60815)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:09:22.071024 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:09:22.071462 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:09:22.084393 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.067s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:09:22.085871 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:09:22.093504 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 9, 22, 90241)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:09:22.094152 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:09:22.094682 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:09:22.117280 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:22.265682 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] creating snapshot='volume-c9bff0fd-4259-41d4-ab52-410890d15ed6.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:09:22.478608 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-c9bff0fd-4259-41d4-ab52-410890d15ed6.clone_snap' to 'volume-c9bff0fd-4259-41d4-ab52-410890d15ed6' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:09:22.738650 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:09:22.740569 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:09:22.741101 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:09:22.798096 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:09:22.798780 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Marking volume c9bff0fd-4259-41d4-ab52-410890d15ed6 as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:09:22.815999 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to c9bff0fd-4259-41d4-ab52-410890d15ed6. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:09:22.816541 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Creating volume glance metadata for volume c9bff0fd-4259-41d4-ab52-410890d15ed6 backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:09:22.936728 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0efd54-9434-4e8e-a4fc-9f180046f76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9bff0fd-4259-41d4-ab52-410890d15ed6', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:22.942419 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6979bc5f-4d11-4b6d-b424-e3b70cdab4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:22.947699 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=68,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:22.966366 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Volume volume-c9bff0fd-4259-41d4-ab52-410890d15ed6 (c9bff0fd-4259-41d4-ab52-410890d15ed6): created successfully Jun 04 21:09:22.970558 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6979bc5f-4d11-4b6d-b424-e3b70cdab4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:22.984544 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Flow 'volume_create_manager' (e88f7733-1ac9-4acb-abb4-6a7f1e55bf9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:09:23.017094 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-d72aefbc-95d3-423f-be70-f02249837f2e tempest-VolumesBackupsTest-1343716541 None] Created volume successfully. Jun 04 21:09:24.270853 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-d4730c90-7fd0-40ff-a2aa-0c5709996c19 tempest-VolumesBackupsTest-1343716541 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-04T21:09:24Z,data_timestamp=2022-06-04T21:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1215353960',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=ac032d42-0889-4dee-aa16-3eb5ae795128,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='78708ead8abd482bab61be479bae7912',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='14f03605fadb4a819444a497e7a2805f',volume_id=c9bff0fd-4259-41d4-ab52-410890d15ed6) Jun 04 21:09:24.272640 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.backup.rpcapi [None req-d4730c90-7fd0-40ff-a2aa-0c5709996c19 tempest-VolumesBackupsTest-1343716541 None] continue_backup in rpcapi backup_id ac032d42-0889-4dee-aa16-3eb5ae795128 {{(pid=130490) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 04 21:09:24.538448 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-d4730c90-7fd0-40ff-a2aa-0c5709996c19 tempest-VolumesBackupsTest-1343716541 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:09:25.492940 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-d4730c90-7fd0-40ff-a2aa-0c5709996c19 tempest-VolumesBackupsTest-1343716541 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.954s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:09:25.493878 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d4730c90-7fd0-40ff-a2aa-0c5709996c19 tempest-VolumesBackupsTest-1343716541 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c9bff0fd-4259-41d4-ab52-410890d15ed6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'c9bff0fd-4259-41d4-ab52-410890d15ed6', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:09:25.526615 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-d4730c90-7fd0-40ff-a2aa-0c5709996c19 tempest-VolumesBackupsTest-1343716541 None] Initialize volume connection completed successfully. Jun 04 21:09:37.682585 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-d4730c90-7fd0-40ff-a2aa-0c5709996c19 tempest-VolumesBackupsTest-1343716541 None] Terminate volume connection completed successfully. Jun 04 21:09:37.731203 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-d4730c90-7fd0-40ff-a2aa-0c5709996c19 tempest-VolumesBackupsTest-1343716541 None] Remove volume export completed successfully. Jun 04 21:09:38.881365 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:09:38.977783 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Flow 'volume_create_manager' (976bbd60-e861-4cd9-8466-6dd866e0260b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:09:39.008630 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04b4e60-06fe-46d5-80d8-41afed4bd4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:39.081150 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04b4e60-06fe-46d5-80d8-41afed4bd4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:09:38Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_ac032d42-0889-4dee-aa16-3eb5ae795128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=add1b1a7-40b5-4bbf-8d80-070adb7ea358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78708ead8abd482bab61be479bae7912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:09:39Z,use_quota=True,user_id='14f03605fadb4a819444a497e7a2805f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:39.093663 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de864dd7-82ff-4e1b-90f3-87ab12bd4f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:39.106570 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de864dd7-82ff-4e1b-90f3-87ab12bd4f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:39.117409 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b11bf24-1f05-41d7-94ab-3d286e735735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:39.130252 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b11bf24-1f05-41d7-94ab-3d286e735735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add1b1a7-40b5-4bbf-8d80-070adb7ea358', 'volume_name': 'volume-add1b1a7-40b5-4bbf-8d80-070adb7ea358', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:39.144386 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80395bf4-b441-456b-865f-7922c185ac87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:39.156475 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80395bf4-b441-456b-865f-7922c185ac87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:39.161555 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc9355b-c705-481a-beed-dcaad746b81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:39.162982 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Volume add1b1a7-40b5-4bbf-8d80-070adb7ea358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add1b1a7-40b5-4bbf-8d80-070adb7ea358', 'volume_size': 1} Jun 04 21:09:39.163606 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] creating volume 'volume-add1b1a7-40b5-4bbf-8d80-070adb7ea358' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:09:39.164981 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:39.375876 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:09:39.376472 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:09:39.395111 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc9355b-c705-481a-beed-dcaad746b81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add1b1a7-40b5-4bbf-8d80-070adb7ea358', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:39.410052 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc4fb8c-8dbc-4f7d-b1dc-d0f84a51aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:09:39.450208 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Volume volume-add1b1a7-40b5-4bbf-8d80-070adb7ea358 (add1b1a7-40b5-4bbf-8d80-070adb7ea358): created successfully Jun 04 21:09:39.464507 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc4fb8c-8dbc-4f7d-b1dc-d0f84a51aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:09:39.492285 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Flow 'volume_create_manager' (976bbd60-e861-4cd9-8466-6dd866e0260b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:09:39.527189 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Created volume successfully. Jun 04 21:09:40.036973 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:09:41.172770 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.136s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:09:41.173541 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-add1b1a7-40b5-4bbf-8d80-070adb7ea358', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'add1b1a7-40b5-4bbf-8d80-070adb7ea358', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:09:41.202982 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Initialize volume connection completed successfully. Jun 04 21:09:45.334155 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:09:45.336144 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:45.449623 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:45.559021 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:09:51.115637 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=73,cinder:UPDATE=10,cinder:INSERT=10,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:51.127320 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Terminate volume connection completed successfully. Jun 04 21:09:51.154455 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ed1d1d93-c7a8-42a3-b7e7-a1fcc515c991 tempest-VolumesBackupsTest-1343716541 None] Remove volume export completed successfully. Jun 04 21:09:51.737847 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-99e85a7d-feb6-4b95-bf78-996684f3da4d tempest-VolumesBackupsTest-1343716541 None] Lock "b'cinder-add1b1a7-40b5-4bbf-8d80-070adb7ea358-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:09:51.853402 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-99e85a7d-feb6-4b95-bf78-996684f3da4d tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:52.659193 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-99e85a7d-feb6-4b95-bf78-996684f3da4d tempest-VolumesBackupsTest-1343716541 None] Volume volume-add1b1a7-40b5-4bbf-8d80-070adb7ea358 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:09:52.716883 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-99e85a7d-feb6-4b95-bf78-996684f3da4d tempest-VolumesBackupsTest-1343716541 None] deleting rbd volume volume-add1b1a7-40b5-4bbf-8d80-070adb7ea358 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:09:53.794311 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=21,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:53.861686 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-99e85a7d-feb6-4b95-bf78-996684f3da4d tempest-VolumesBackupsTest-1343716541 None] Created reservations ['883cc112-b9a2-4110-873e-5076bd2742c1', 'e012fb74-2935-4c97-91f7-14e2ce64722a', '8df38163-74fd-4c58-9713-e57573fdc2bb', '0f7200a2-3789-4b45-9962-2fb83e06d8b2'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:09:53.948147 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-99e85a7d-feb6-4b95-bf78-996684f3da4d tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:54.040521 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-99e85a7d-feb6-4b95-bf78-996684f3da4d tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:54.136806 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-99e85a7d-feb6-4b95-bf78-996684f3da4d tempest-VolumesBackupsTest-1343716541 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:09:54.142791 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-99e85a7d-feb6-4b95-bf78-996684f3da4d tempest-VolumesBackupsTest-1343716541 None] Deleted volume successfully. Jun 04 21:09:54.166897 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-99e85a7d-feb6-4b95-bf78-996684f3da4d tempest-VolumesBackupsTest-1343716541 None] Lock "b'cinder-add1b1a7-40b5-4bbf-8d80-070adb7ea358-delete_volume'" released by "delete_volume" :: held 2.428s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:09:56.205817 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-1508a5ff-ff77-40c5-9f50-42672f10634a tempest-VolumesBackupsTest-1343716541 None] Lock "b'cinder-c9bff0fd-4259-41d4-ab52-410890d15ed6-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:09:56.287379 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1508a5ff-ff77-40c5-9f50-42672f10634a tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:57.365710 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1508a5ff-ff77-40c5-9f50-42672f10634a tempest-VolumesBackupsTest-1343716541 None] deleting rbd volume volume-c9bff0fd-4259-41d4-ab52-410890d15ed6 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:09:57.878899 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1508a5ff-ff77-40c5-9f50-42672f10634a tempest-VolumesBackupsTest-1343716541 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:09:57.925254 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1508a5ff-ff77-40c5-9f50-42672f10634a tempest-VolumesBackupsTest-1343716541 None] deleting parent snapshot volume-c9bff0fd-4259-41d4-ab52-410890d15ed6.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:09:58.538558 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-1508a5ff-ff77-40c5-9f50-42672f10634a tempest-VolumesBackupsTest-1343716541 None] Created reservations ['95da4c7f-a364-4a9c-8cad-c9edd6d241fb', '136482ad-8595-4888-bf95-368a5a528d54', '4e2c6004-11a5-4abb-bf97-78f9fed1c52c', 'f24e3047-7d69-45fd-b75c-51105a7d1630'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:09:58.638862 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1508a5ff-ff77-40c5-9f50-42672f10634a tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:58.721450 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1508a5ff-ff77-40c5-9f50-42672f10634a tempest-VolumesBackupsTest-1343716541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:09:58.758795 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-1508a5ff-ff77-40c5-9f50-42672f10634a tempest-VolumesBackupsTest-1343716541 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:09:58.768882 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1508a5ff-ff77-40c5-9f50-42672f10634a tempest-VolumesBackupsTest-1343716541 None] Deleted volume successfully. Jun 04 21:09:58.792846 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-1508a5ff-ff77-40c5-9f50-42672f10634a tempest-VolumesBackupsTest-1343716541 None] Lock "b'cinder-c9bff0fd-4259-41d4-ab52-410890d15ed6-delete_volume'" released by "delete_volume" :: held 2.588s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:10:08.779882 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=29,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:09.262646 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:10:09.288732 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Flow 'volume_create_manager' (9e178f85-963f-417d-a403-81fe909377dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:10:09.296317 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605b8957-f7e7-475b-bc1d-18c1b781fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:09.329031 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605b8957-f7e7-475b-bc1d-18c1b781fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1461796406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1433bbc4-49a6-4d41-b98e-d9e0054a4d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241876e358514965aadcc36146a30265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:10:09Z,use_quota=True,user_id='0678a3e330f449d8acf9c01cda1808be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:09.350893 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a15d9b-5013-4dc0-9d0d-deb16d2da185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:09.382928 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a15d9b-5013-4dc0-9d0d-deb16d2da185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:09.406069 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4eb4451-3a49-4cef-b586-02c1033e8987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:09.422494 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4eb4451-3a49-4cef-b586-02c1033e8987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1433bbc4-49a6-4d41-b98e-d9e0054a4d74', 'volume_name': 'volume-1433bbc4-49a6-4d41-b98e-d9e0054a4d74', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:09.442270 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3012877-9848-4539-b170-e1ec23e7b7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:09.451875 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3012877-9848-4539-b170-e1ec23e7b7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:09.466909 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bdc76d-80cf-4cbe-82d8-72640378e4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:09.470684 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Volume 1433bbc4-49a6-4d41-b98e-d9e0054a4d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1433bbc4-49a6-4d41-b98e-d9e0054a4d74', 'volume_size': 1} Jun 04 21:10:09.471761 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] creating volume 'volume-1433bbc4-49a6-4d41-b98e-d9e0054a4d74' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:10:09.474052 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:09.715849 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:10:09.716749 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:10:09.722239 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bdc76d-80cf-4cbe-82d8-72640378e4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1433bbc4-49a6-4d41-b98e-d9e0054a4d74', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:09.729751 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cd8a90-0070-4acc-abfd-6f4c8ebd18e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:09.750206 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Volume volume-1433bbc4-49a6-4d41-b98e-d9e0054a4d74 (1433bbc4-49a6-4d41-b98e-d9e0054a4d74): created successfully Jun 04 21:10:09.754734 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cd8a90-0070-4acc-abfd-6f4c8ebd18e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:09.762461 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Flow 'volume_create_manager' (9e178f85-963f-417d-a403-81fe909377dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:10:09.776710 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-43319949-27bd-493e-a9ac-22b9fbda7bcc tempest-VolumesNegativeTest-2071514133 None] Created volume successfully. Jun 04 21:10:24.595142 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=27,cinder:INSERT=7,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:34.603744 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:45.334323 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:10:45.335703 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:45.423986 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:45.529280 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:10:47.545684 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0d30a2c9-b64e-47f3-b2e1-13e138ca0776 tempest-VolumesNegativeTest-2071514133 None] Lock "b'cinder-1433bbc4-49a6-4d41-b98e-d9e0054a4d74-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:10:47.585000 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d30a2c9-b64e-47f3-b2e1-13e138ca0776 tempest-VolumesNegativeTest-2071514133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:47.687294 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d30a2c9-b64e-47f3-b2e1-13e138ca0776 tempest-VolumesNegativeTest-2071514133 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:10:47.687981 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d30a2c9-b64e-47f3-b2e1-13e138ca0776 tempest-VolumesNegativeTest-2071514133 None] Volume volume-1433bbc4-49a6-4d41-b98e-d9e0054a4d74 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:10:47.697823 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d30a2c9-b64e-47f3-b2e1-13e138ca0776 tempest-VolumesNegativeTest-2071514133 None] deleting rbd volume volume-1433bbc4-49a6-4d41-b98e-d9e0054a4d74 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:10:48.182407 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-0d30a2c9-b64e-47f3-b2e1-13e138ca0776 tempest-VolumesNegativeTest-2071514133 None] Created reservations ['3fddb648-12d7-474f-a769-484a63a60fb7', 'a642f3d4-f5bd-4b2b-a271-2870b0993d3f', '8082149a-1c03-4c3c-8fc2-e02b51e8ae18', '81882941-fab0-49d8-8317-27bee3257562'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:10:48.287647 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d30a2c9-b64e-47f3-b2e1-13e138ca0776 tempest-VolumesNegativeTest-2071514133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:48.355658 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d30a2c9-b64e-47f3-b2e1-13e138ca0776 tempest-VolumesNegativeTest-2071514133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:48.419640 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0d30a2c9-b64e-47f3-b2e1-13e138ca0776 tempest-VolumesNegativeTest-2071514133 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:10:48.426608 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0d30a2c9-b64e-47f3-b2e1-13e138ca0776 tempest-VolumesNegativeTest-2071514133 None] Deleted volume successfully. Jun 04 21:10:48.470983 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0d30a2c9-b64e-47f3-b2e1-13e138ca0776 tempest-VolumesNegativeTest-2071514133 None] Lock "b'cinder-1433bbc4-49a6-4d41-b98e-d9e0054a4d74-delete_volume'" released by "delete_volume" :: held 0.925s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:10:53.370512 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:10:53.442624 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Flow 'volume_create_manager' (1411da1e-9646-42d1-9649-3b1b176447b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:10:53.460694 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f1f6af-bea8-43b3-8fa9-0ab3dff8d526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:53.533318 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f1f6af-bea8-43b3-8fa9-0ab3dff8d526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1315258208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f1518377e6472e808f8fd8ac986c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:10:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:10:53Z,use_quota=True,user_id='fe6cf304a0b443d69ae741fd182c08cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:53.566284 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b625cf-9b7a-4124-98d5-c1c1b8aed5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:53.575688 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b625cf-9b7a-4124-98d5-c1c1b8aed5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:53.589054 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f4044b-4fde-45b3-a2e7-8ab149132b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:53.599188 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f4044b-4fde-45b3-a2e7-8ab149132b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d', 'volume_name': 'volume-5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d', 'volume_size': 2}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:53.608348 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9270a64-5f0a-46ce-a95f-df501f973c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:53.633277 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9270a64-5f0a-46ce-a95f-df501f973c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:53.643789 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a8b028-5d1a-466c-adab-00b1135c6412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:53.645265 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Volume 5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d', 'volume_size': 2} Jun 04 21:10:53.645685 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] creating volume 'volume-5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:10:53.650456 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:53.808523 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:10:53.809225 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:10:53.814026 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a8b028-5d1a-466c-adab-00b1135c6412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d', 'volume_size': 2}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:53.826114 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9095541-68ab-457f-8040-92cce607e7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:10:53.853224 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Volume volume-5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d (5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d): created successfully Jun 04 21:10:53.858563 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9095541-68ab-457f-8040-92cce607e7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:10:53.870358 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Flow 'volume_create_manager' (1411da1e-9646-42d1-9649-3b1b176447b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:10:53.898241 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4e23dffc-75c1-4ec5-acf8-4c678481927a tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Created volume successfully. Jun 04 21:10:54.761683 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=26,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:54.796306 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0dce1e9e-947a-46ff-b3fa-f4a3466942d0 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:55.134665 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0dce1e9e-947a-46ff-b3fa-f4a3466942d0 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Create snapshot completed successfully Jun 04 21:10:55.983676 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-b46706ad-4592-4613-9105-cc9ede6dbf15 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Lock "b'cinder-630fa459-ee38-45c7-b7d2-5481cbb99f18-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:10:55.994133 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b46706ad-4592-4613-9105-cc9ede6dbf15 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:57.262095 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-b46706ad-4592-4613-9105-cc9ede6dbf15 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Created reservations ['5fcda95f-07c6-400f-a6b1-cef60a11b000', '2330d623-bdd9-481e-b2ee-bc136103449d', '4f099f3d-5352-4eb9-b434-c33ea2e77dce', '1857cfea-b57a-4631-a589-9ff32dbff462'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:10:57.369527 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b46706ad-4592-4613-9105-cc9ede6dbf15 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Delete snapshot completed successfully. Jun 04 21:10:57.382413 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-b46706ad-4592-4613-9105-cc9ede6dbf15 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Lock "b'cinder-630fa459-ee38-45c7-b7d2-5481cbb99f18-delete_snapshot'" released by "delete_snapshot" :: held 1.411s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:10:58.308723 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-5e4063d1-4469-4759-87aa-bd08549758d4 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Lock "b'cinder-5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:10:58.408276 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5e4063d1-4469-4759-87aa-bd08549758d4 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:58.540735 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5e4063d1-4469-4759-87aa-bd08549758d4 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:10:58.541365 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5e4063d1-4469-4759-87aa-bd08549758d4 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Volume volume-5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:10:58.565405 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5e4063d1-4469-4759-87aa-bd08549758d4 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] deleting rbd volume volume-5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:10:59.248257 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-5e4063d1-4469-4759-87aa-bd08549758d4 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Created reservations ['43c181d5-71a5-4be3-8914-021568c2ea7b', '98b3943d-60b5-44f0-ab2e-c147fa757458', 'a7f678f1-aed5-4ac3-b805-1d83866bb917', 'd6683464-e0a0-4830-bacb-af8225ddc8c2'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:10:59.351246 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5e4063d1-4469-4759-87aa-bd08549758d4 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:59.426596 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5e4063d1-4469-4759-87aa-bd08549758d4 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:10:59.508603 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-5e4063d1-4469-4759-87aa-bd08549758d4 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:10:59.518553 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-5e4063d1-4469-4759-87aa-bd08549758d4 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Deleted volume successfully. Jun 04 21:10:59.550513 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-5e4063d1-4469-4759-87aa-bd08549758d4 tempest-VolumesSnapshotNegativeTestJSON-1962431251 None] Lock "b'cinder-5ebc1f92-77c0-4b99-bd54-ed08d67e0c6d-delete_volume'" released by "delete_volume" :: held 1.242s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:11:10.127829 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=45,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:10.136105 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b1e07eb8-ae52-4f7d-884d-368717deeaf0 tempest-GroupSnapshotsV319Test-1563996585 None] Group tempest-GroupSnapshotsV319Test-Group-1625162803: creating Jun 04 21:11:10.185184 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b1e07eb8-ae52-4f7d-884d-368717deeaf0 tempest-GroupSnapshotsV319Test-1563996585 None] Group tempest-GroupSnapshotsV319Test-Group-1625162803: created successfully Jun 04 21:11:10.199571 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b1e07eb8-ae52-4f7d-884d-368717deeaf0 tempest-GroupSnapshotsV319Test-1563996585 None] Create group completed successfully. Jun 04 21:11:12.000291 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:11:12.067562 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Flow 'volume_create_manager' (1f5e2df5-559b-41ad-9218-a6c5c38b8b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:12.104256 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1c044b-83dc-4cee-af39-88e1fa32fc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:12.144122 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1c044b-83dc-4cee-af39-88e1fa32fc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-1662508897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=10569e6f-b26e-4a5a-8fde-febf2e0c9fd9,host='ncdv-master-1@ceph#ceph',id=9c3e4822-e856-4b0a-9e8e-ad1042040dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a3a64114fac4463a413491b0c9814eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:11:12Z,use_quota=True,user_id='3543143d38224382951e099fba0170ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a912b99-5906-4876-9146-c3d091622573),volume_type_id=8a912b99-5906-4876-9146-c3d091622573)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:12.165365 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4849e470-df47-4654-b830-bbb87ffc3023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:12.170587 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4849e470-df47-4654-b830-bbb87ffc3023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:12.176395 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143c5fa2-0092-406b-86ed-4e80606b01d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:12.180928 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143c5fa2-0092-406b-86ed-4e80606b01d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3e4822-e856-4b0a-9e8e-ad1042040dec', 'volume_name': 'volume-9c3e4822-e856-4b0a-9e8e-ad1042040dec', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:12.196556 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa15936-25df-4fd1-8c00-ddb96348dcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:12.206987 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa15936-25df-4fd1-8c00-ddb96348dcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:12.221618 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad6bc64-71b2-4287-b9ec-bf0f702ef89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:12.224192 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Volume 9c3e4822-e856-4b0a-9e8e-ad1042040dec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3e4822-e856-4b0a-9e8e-ad1042040dec', 'volume_size': 1} Jun 04 21:11:12.225257 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] creating volume 'volume-9c3e4822-e856-4b0a-9e8e-ad1042040dec' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:11:12.228485 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:12.381863 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:11:12.382653 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:11:12.388533 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad6bc64-71b2-4287-b9ec-bf0f702ef89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3e4822-e856-4b0a-9e8e-ad1042040dec', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:12.398979 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6580534a-8d95-4cd8-afbe-59d121414e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:12.418690 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Volume volume-9c3e4822-e856-4b0a-9e8e-ad1042040dec (9c3e4822-e856-4b0a-9e8e-ad1042040dec): created successfully Jun 04 21:11:12.425777 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6580534a-8d95-4cd8-afbe-59d121414e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:12.439556 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Flow 'volume_create_manager' (1f5e2df5-559b-41ad-9218-a6c5c38b8b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:12.455237 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4535be9d-bc24-48a3-ba25-66a4969ff6b2 tempest-GroupSnapshotsV319Test-1563996585 None] Created volume successfully. Jun 04 21:11:13.114978 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:11:13.169596 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Flow 'volume_create_manager' (be5d224f-1767-442d-94e9-8ae170eb14b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:13.178624 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89318d4f-ade4-49ce-84bc-386151a03037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:13.212084 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89318d4f-ade4-49ce-84bc-386151a03037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1550788047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=26d9f5fb-fdb4-420b-a47f-80c005582589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfea83c42bb443459619d4d679aa1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:11:13Z,use_quota=True,user_id='f290b5d01a074e2c9859488bd4ff1162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:13.221353 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6d6bb3-a002-479c-a2d2-06e9792f6fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:13.235412 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6d6bb3-a002-479c-a2d2-06e9792f6fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:13.244724 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc63953f-d9f5-4e20-aa94-8da90cde0ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:13.258216 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc63953f-d9f5-4e20-aa94-8da90cde0ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d9f5fb-fdb4-420b-a47f-80c005582589', 'volume_name': 'volume-26d9f5fb-fdb4-420b-a47f-80c005582589', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:13.272713 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38729ed6-f73b-4008-818a-ebd5e2217551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:13.283332 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38729ed6-f73b-4008-818a-ebd5e2217551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:13.294802 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f7d42b-53c4-41f4-a513-5164e9a786ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:13.297217 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Volume 26d9f5fb-fdb4-420b-a47f-80c005582589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d9f5fb-fdb4-420b-a47f-80c005582589', 'volume_size': 1} Jun 04 21:11:13.298996 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] creating volume 'volume-26d9f5fb-fdb4-420b-a47f-80c005582589' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:11:13.299818 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:13.428341 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-daa2ac30-5d4a-4206-ad42-7223a39734b0 tempest-GroupSnapshotsV319Test-1563996585 None] GroupSnapshot f068bb39-2495-448c-bba2-9103d41a2425: creating. Jun 04 21:11:13.470891 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-daa2ac30-5d4a-4206-ad42-7223a39734b0 tempest-GroupSnapshotsV319Test-1563996585 None] Group snapshot f068bb39-2495-448c-bba2-9103d41a2425: creating. {{(pid=130490) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4082}} Jun 04 21:11:13.479122 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:11:13.479711 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:11:13.483850 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f7d42b-53c4-41f4-a513-5164e9a786ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d9f5fb-fdb4-420b-a47f-80c005582589', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:13.489826 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106c8087-6320-4b35-acc2-8cc32eddfd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:13.516473 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Volume volume-26d9f5fb-fdb4-420b-a47f-80c005582589 (26d9f5fb-fdb4-420b-a47f-80c005582589): created successfully Jun 04 21:11:13.521286 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106c8087-6320-4b35-acc2-8cc32eddfd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:13.530280 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Flow 'volume_create_manager' (be5d224f-1767-442d-94e9-8ae170eb14b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:13.539202 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-daa2ac30-5d4a-4206-ad42-7223a39734b0 tempest-GroupSnapshotsV319Test-1563996585 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:13.631920 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-86bd7ca2-4329-4cbc-b374-49d7be00d5ba tempest-AttachVolumeTestJSON-1210396921 None] Created volume successfully. Jun 04 21:11:14.917363 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-daa2ac30-5d4a-4206-ad42-7223a39734b0 tempest-GroupSnapshotsV319Test-1563996585 None] group_snapshot f068bb39-2495-448c-bba2-9103d41a2425: created successfully Jun 04 21:11:15.113836 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad req-e1399064-d465-4b7c-afd0-a3bc1f8cfb9f tempest-AttachVolumeTestJSON-1210396921 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:11:16.182615 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad req-e1399064-d465-4b7c-afd0-a3bc1f8cfb9f tempest-AttachVolumeTestJSON-1210396921 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.068s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:11:16.185920 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad req-e1399064-d465-4b7c-afd0-a3bc1f8cfb9f tempest-AttachVolumeTestJSON-1210396921 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-26d9f5fb-fdb4-420b-a47f-80c005582589', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '26d9f5fb-fdb4-420b-a47f-80c005582589', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:11:16.231357 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad req-e1399064-d465-4b7c-afd0-a3bc1f8cfb9f tempest-AttachVolumeTestJSON-1210396921 None] Connection info returned from driver {'name': 'volumes/volume-26d9f5fb-fdb4-420b-a47f-80c005582589', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '26d9f5fb-fdb4-420b-a47f-80c005582589', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '988b3a7b-8b21-43b4-906e-8c0a95cf20ee'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:11:16.312626 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-43c7adb8-5690-4e79-96d4-3a6088e15ffc tempest-GroupSnapshotsV319Test-1563996585 None] group_snapshot f068bb39-2495-448c-bba2-9103d41a2425: deleting Jun 04 21:11:16.340869 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-43c7adb8-5690-4e79-96d4-3a6088e15ffc tempest-GroupSnapshotsV319Test-1563996585 None] group_snapshot f068bb39-2495-448c-bba2-9103d41a2425: deleting {{(pid=130490) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4257}} Jun 04 21:11:16.385905 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-43c7adb8-5690-4e79-96d4-3a6088e15ffc tempest-GroupSnapshotsV319Test-1563996585 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:16.514279 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad req-e1399064-d465-4b7c-afd0-a3bc1f8cfb9f tempest-AttachVolumeTestJSON-1210396921 None] attachment_update completed successfully. Jun 04 21:11:17.886846 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=67,cinder:UPDATE=27,cinder:INSERT=4,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:17.956927 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-43c7adb8-5690-4e79-96d4-3a6088e15ffc tempest-GroupSnapshotsV319Test-1563996585 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1246589350 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1246589350, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:11:17.962361 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-43c7adb8-5690-4e79-96d4-3a6088e15ffc tempest-GroupSnapshotsV319Test-1563996585 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1246589350 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1246589350, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:11:18.033323 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-43c7adb8-5690-4e79-96d4-3a6088e15ffc tempest-GroupSnapshotsV319Test-1563996585 None] Created reservations ['100c599e-92d6-4609-bd59-47befeba0e33', '154a7176-4366-4ea2-aefc-dbe46e0597d6', 'e7553041-f28b-409c-80a1-0b12a02a064e', '01651868-c06a-461d-8b67-a94e1bebe0e5'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:11:18.250302 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-43c7adb8-5690-4e79-96d4-3a6088e15ffc tempest-GroupSnapshotsV319Test-1563996585 None] group_snapshot f068bb39-2495-448c-bba2-9103d41a2425: deleted successfully Jun 04 21:11:19.017928 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2f957017-776b-41e4-8e2b-bdef5e0183b1 tempest-GroupSnapshotsV319Test-1563996585 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:19.109612 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2f957017-776b-41e4-8e2b-bdef5e0183b1 tempest-GroupSnapshotsV319Test-1563996585 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:11:19.110061 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2f957017-776b-41e4-8e2b-bdef5e0183b1 tempest-GroupSnapshotsV319Test-1563996585 None] Volume volume-9c3e4822-e856-4b0a-9e8e-ad1042040dec is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:11:19.129338 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2f957017-776b-41e4-8e2b-bdef5e0183b1 tempest-GroupSnapshotsV319Test-1563996585 None] deleting rbd volume volume-9c3e4822-e856-4b0a-9e8e-ad1042040dec {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:11:19.556080 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:11:19.602527 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Flow 'volume_create_manager' (4d5affaf-acb8-4599-b509-32eb7672848b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:19.628111 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15687862-2aa2-40c1-a266-bc75fed3fa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:19.660313 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15687862-2aa2-40c1-a266-bc75fed3fa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-190154498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=14d67208-c233-4663-b9a2-c40b86117130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfea83c42bb443459619d4d679aa1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:11:20Z,use_quota=True,user_id='f290b5d01a074e2c9859488bd4ff1162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:19.667490 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665f0ace-8748-479c-a99f-663e47338d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:19.671816 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665f0ace-8748-479c-a99f-663e47338d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:19.677986 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c17f973-4bfe-407f-965f-34d0c72e2a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:19.682749 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c17f973-4bfe-407f-965f-34d0c72e2a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14d67208-c233-4663-b9a2-c40b86117130', 'volume_name': 'volume-14d67208-c233-4663-b9a2-c40b86117130', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:19.696233 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97959ba2-c61f-4a41-8833-a3a3e3f51321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:19.702190 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97959ba2-c61f-4a41-8833-a3a3e3f51321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:19.706939 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b88425-1a48-46ef-bda0-dbf0c18fb22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:19.708274 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Volume 14d67208-c233-4663-b9a2-c40b86117130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14d67208-c233-4663-b9a2-c40b86117130', 'volume_size': 1} Jun 04 21:11:19.708896 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] creating volume 'volume-14d67208-c233-4663-b9a2-c40b86117130' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:11:19.710002 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:19.906349 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:11:19.907359 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:11:19.911790 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b88425-1a48-46ef-bda0-dbf0c18fb22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14d67208-c233-4663-b9a2-c40b86117130', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:19.919313 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cca028-d4c9-472f-8194-e0083ed565e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:19.958975 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Volume volume-14d67208-c233-4663-b9a2-c40b86117130 (14d67208-c233-4663-b9a2-c40b86117130): created successfully Jun 04 21:11:19.964763 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cca028-d4c9-472f-8194-e0083ed565e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:19.976264 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Flow 'volume_create_manager' (4d5affaf-acb8-4599-b509-32eb7672848b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:19.998366 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ab9ed240-e9f1-4410-8f7b-3cef24b459ce tempest-AttachVolumeTestJSON-1210396921 None] Created volume successfully. Jun 04 21:11:20.105374 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-2f957017-776b-41e4-8e2b-bdef5e0183b1 tempest-GroupSnapshotsV319Test-1563996585 None] Created reservations ['8dc0fcf7-1016-4f17-91f9-3fff1a72800d'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:11:20.163046 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-2f957017-776b-41e4-8e2b-bdef5e0183b1 tempest-GroupSnapshotsV319Test-1563996585 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1246589350 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1246589350, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:11:20.198426 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-2f957017-776b-41e4-8e2b-bdef5e0183b1 tempest-GroupSnapshotsV319Test-1563996585 None] Created reservations ['3a6650bf-73dd-4b66-a228-93798c55f1b4', 'a0e1c5cc-e683-415a-9686-2788edf9b2c9', '6b3e2244-3b99-4a13-9aa8-287fa46b0e14', 'c1e61809-f06e-418a-a3bf-990609bf3854'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:11:20.218399 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=69,cinder:UPDATE=21,cinder:DELETE=2,cinder:INSERT=8 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:20.425553 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2f957017-776b-41e4-8e2b-bdef5e0183b1 tempest-GroupSnapshotsV319Test-1563996585 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:20.489938 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2f957017-776b-41e4-8e2b-bdef5e0183b1 tempest-GroupSnapshotsV319Test-1563996585 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:20.565824 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-2f957017-776b-41e4-8e2b-bdef5e0183b1 tempest-GroupSnapshotsV319Test-1563996585 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:11:20.571569 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2f957017-776b-41e4-8e2b-bdef5e0183b1 tempest-GroupSnapshotsV319Test-1563996585 None] Delete group completed successfully. Jun 04 21:11:21.404950 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-23a45334-ee21-483f-bcb8-531f7f8e47c4 req-d60cb1f2-17ec-4668-ab2e-dfd79e2bc991 tempest-AttachVolumeTestJSON-1210396921 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:11:22.732002 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-23a45334-ee21-483f-bcb8-531f7f8e47c4 req-d60cb1f2-17ec-4668-ab2e-dfd79e2bc991 tempest-AttachVolumeTestJSON-1210396921 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.327s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:11:22.733101 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-23a45334-ee21-483f-bcb8-531f7f8e47c4 req-d60cb1f2-17ec-4668-ab2e-dfd79e2bc991 tempest-AttachVolumeTestJSON-1210396921 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-14d67208-c233-4663-b9a2-c40b86117130', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '14d67208-c233-4663-b9a2-c40b86117130', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:11:22.838595 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-23a45334-ee21-483f-bcb8-531f7f8e47c4 req-d60cb1f2-17ec-4668-ab2e-dfd79e2bc991 tempest-AttachVolumeTestJSON-1210396921 None] Connection info returned from driver {'name': 'volumes/volume-14d67208-c233-4663-b9a2-c40b86117130', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '14d67208-c233-4663-b9a2-c40b86117130', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9487f74b-2212-4b43-ad78-f98e619592d1'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:11:23.011495 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-23a45334-ee21-483f-bcb8-531f7f8e47c4 req-d60cb1f2-17ec-4668-ab2e-dfd79e2bc991 tempest-AttachVolumeTestJSON-1210396921 None] attachment_update completed successfully. Jun 04 21:11:27.565056 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-6e2d53db-2e01-49df-b5d8-4990e0b299c8 req-d6398225-5ca5-4721-9b16-b958a6fbfa0e tempest-AttachVolumeTestJSON-1210396921 None] Terminate volume connection completed successfully. Jun 04 21:11:27.565747 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-6e2d53db-2e01-49df-b5d8-4990e0b299c8 req-d6398225-5ca5-4721-9b16-b958a6fbfa0e tempest-AttachVolumeTestJSON-1210396921 None] Deleting attachment 988b3a7b-8b21-43b4-906e-8c0a95cf20ee. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:11:28.690700 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:11:28.731289 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Flow 'volume_create_manager' (5bac89d6-bb33-4f2f-8006-9829c141226f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:28.740796 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e3aec0-3af0-4148-91f4-c79602964773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:28.766828 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e3aec0-3af0-4148-91f4-c79602964773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1710405875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=795f6f6e-5d43-4bb4-8d7d-b2684b160d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3bb2e403511423da10e8427c597ef6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:11:29Z,use_quota=True,user_id='dbc154d4eba04bce8f41de44a97fd257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:28.775606 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cd9aeb-4012-48a1-a59d-0238e75c2fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:28.783612 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cd9aeb-4012-48a1-a59d-0238e75c2fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:28.789615 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b76825-755b-4f72-9e14-492ecc5da3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:28.797089 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b76825-755b-4f72-9e14-492ecc5da3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795f6f6e-5d43-4bb4-8d7d-b2684b160d70', 'volume_name': 'volume-795f6f6e-5d43-4bb4-8d7d-b2684b160d70', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:28.802862 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b945e0b8-c2a4-416a-8e11-a7f146d1482a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:28.807703 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b945e0b8-c2a4-416a-8e11-a7f146d1482a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:28.812614 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5c0af3-097e-440e-b300-457dd1ca2712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:28.815189 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Volume 795f6f6e-5d43-4bb4-8d7d-b2684b160d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795f6f6e-5d43-4bb4-8d7d-b2684b160d70', 'volume_size': 1} Jun 04 21:11:28.815675 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] creating volume 'volume-795f6f6e-5d43-4bb4-8d7d-b2684b160d70' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:11:28.816693 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:28.931060 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:11:28.931572 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:11:28.935810 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5c0af3-097e-440e-b300-457dd1ca2712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795f6f6e-5d43-4bb4-8d7d-b2684b160d70', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:28.940313 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d19f1f-b3d6-4df3-a158-f3dcda8c8bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:28.957310 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Volume volume-795f6f6e-5d43-4bb4-8d7d-b2684b160d70 (795f6f6e-5d43-4bb4-8d7d-b2684b160d70): created successfully Jun 04 21:11:28.962459 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d19f1f-b3d6-4df3-a158-f3dcda8c8bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:28.969107 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Flow 'volume_create_manager' (5bac89d6-bb33-4f2f-8006-9829c141226f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:28.980252 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a48caa6f-84f3-419f-868f-d84b10ef1a8b tempest-VolumesBackupsAdminTest-568448284 None] Created volume successfully. Jun 04 21:11:29.329238 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-80df823f-11d7-483c-89cc-641bcdde08e3 req-afa8dcee-05cf-4dc0-ad0d-597f8ec24233 tempest-AttachVolumeTestJSON-1210396921 None] Terminate volume connection completed successfully. Jun 04 21:11:29.329749 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-80df823f-11d7-483c-89cc-641bcdde08e3 req-afa8dcee-05cf-4dc0-ad0d-597f8ec24233 tempest-AttachVolumeTestJSON-1210396921 None] Deleting attachment 9487f74b-2212-4b43-ad78-f98e619592d1. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:11:29.933163 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4b1fe5d3-c225-4f39-915a-e44033a43b2f tempest-VolumesBackupsAdminTest-568448284 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-04T21:11:29Z,data_timestamp=2022-06-04T21:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-219394074',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=90215a2a-b324-469c-a28d-9a92ec63ccbb,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d3bb2e403511423da10e8427c597ef6d',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='dbc154d4eba04bce8f41de44a97fd257',volume_id=795f6f6e-5d43-4bb4-8d7d-b2684b160d70) Jun 04 21:11:29.936827 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.backup.rpcapi [None req-4b1fe5d3-c225-4f39-915a-e44033a43b2f tempest-VolumesBackupsAdminTest-568448284 None] continue_backup in rpcapi backup_id 90215a2a-b324-469c-a28d-9a92ec63ccbb {{(pid=130490) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 04 21:11:30.167826 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-4b1fe5d3-c225-4f39-915a-e44033a43b2f tempest-VolumesBackupsAdminTest-568448284 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:11:30.904412 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-4b1fe5d3-c225-4f39-915a-e44033a43b2f tempest-VolumesBackupsAdminTest-568448284 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.736s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:11:30.905440 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4b1fe5d3-c225-4f39-915a-e44033a43b2f tempest-VolumesBackupsAdminTest-568448284 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-795f6f6e-5d43-4bb4-8d7d-b2684b160d70', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '795f6f6e-5d43-4bb4-8d7d-b2684b160d70', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:11:30.926287 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4b1fe5d3-c225-4f39-915a-e44033a43b2f tempest-VolumesBackupsAdminTest-568448284 None] Initialize volume connection completed successfully. Jun 04 21:11:33.031581 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4b1fe5d3-c225-4f39-915a-e44033a43b2f tempest-VolumesBackupsAdminTest-568448284 None] Terminate volume connection completed successfully. Jun 04 21:11:33.069384 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4b1fe5d3-c225-4f39-915a-e44033a43b2f tempest-VolumesBackupsAdminTest-568448284 None] Remove volume export completed successfully. Jun 04 21:11:36.979541 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:11:37.035854 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Flow 'volume_create_manager' (96b413dc-b59a-4ad9-a295-24104272b992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:37.056838 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8003259-8a86-4ace-83da-c86329077cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:37.112686 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8003259-8a86-4ace-83da-c86329077cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:11:36Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_90215a2a-b324-469c-a28d-9a92ec63ccbb',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7e9d9094-78d3-4f3f-826d-3c231fb9e91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3bb2e403511423da10e8427c597ef6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:11:37Z,use_quota=True,user_id='dbc154d4eba04bce8f41de44a97fd257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:37.126960 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2fd8f4-4527-487e-97f5-32d148cbf12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:37.134105 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2fd8f4-4527-487e-97f5-32d148cbf12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:37.148504 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65c47be-d8c4-4684-8fd3-d9a24e5c9d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:37.169668 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65c47be-d8c4-4684-8fd3-d9a24e5c9d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e9d9094-78d3-4f3f-826d-3c231fb9e91e', 'volume_name': 'volume-7e9d9094-78d3-4f3f-826d-3c231fb9e91e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:37.181994 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fabbee4-6c0b-4087-81f2-d1bd0dfbb482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:37.186738 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fabbee4-6c0b-4087-81f2-d1bd0dfbb482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:37.202779 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8836c4a-7ba8-43a3-9e12-73f525002495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:37.204331 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Volume 7e9d9094-78d3-4f3f-826d-3c231fb9e91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e9d9094-78d3-4f3f-826d-3c231fb9e91e', 'volume_size': 1} Jun 04 21:11:37.204952 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] creating volume 'volume-7e9d9094-78d3-4f3f-826d-3c231fb9e91e' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:11:37.208817 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:37.436075 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:11:37.436518 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:11:37.440203 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8836c4a-7ba8-43a3-9e12-73f525002495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9d9094-78d3-4f3f-826d-3c231fb9e91e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:37.446683 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a0fd21-28c1-4d8b-915d-132dc6edf556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:37.480247 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Volume volume-7e9d9094-78d3-4f3f-826d-3c231fb9e91e (7e9d9094-78d3-4f3f-826d-3c231fb9e91e): created successfully Jun 04 21:11:37.484458 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a0fd21-28c1-4d8b-915d-132dc6edf556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:37.502289 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Flow 'volume_create_manager' (96b413dc-b59a-4ad9-a295-24104272b992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:37.541722 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Created volume successfully. Jun 04 21:11:38.313734 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:11:40.145509 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.831s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:11:40.147627 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7e9d9094-78d3-4f3f-826d-3c231fb9e91e', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '7e9d9094-78d3-4f3f-826d-3c231fb9e91e', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:11:40.175578 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Initialize volume connection completed successfully. Jun 04 21:11:41.608736 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-9a30c07c-bcf5-4a36-9e20-62fae3e0126c tempest-AttachVolumeTestJSON-1210396921 None] Lock "b'cinder-14d67208-c233-4663-b9a2-c40b86117130-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:11:41.694666 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9a30c07c-bcf5-4a36-9e20-62fae3e0126c tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:41.802869 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9a30c07c-bcf5-4a36-9e20-62fae3e0126c tempest-AttachVolumeTestJSON-1210396921 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:11:41.803264 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9a30c07c-bcf5-4a36-9e20-62fae3e0126c tempest-AttachVolumeTestJSON-1210396921 None] Volume volume-14d67208-c233-4663-b9a2-c40b86117130 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:11:41.841849 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9a30c07c-bcf5-4a36-9e20-62fae3e0126c tempest-AttachVolumeTestJSON-1210396921 None] deleting rbd volume volume-14d67208-c233-4663-b9a2-c40b86117130 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:11:42.187473 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Terminate volume connection completed successfully. Jun 04 21:11:42.303312 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2e95c7ff-cb27-486d-a2bc-65fce614ac60 tempest-VolumesBackupsAdminTest-568448284 None] Remove volume export completed successfully. Jun 04 21:11:42.836949 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-9a30c07c-bcf5-4a36-9e20-62fae3e0126c tempest-AttachVolumeTestJSON-1210396921 None] Created reservations ['7f920716-5ea0-4a12-93a3-ebfdf0d07d65', '365dd618-d439-4911-99d7-3757f4ba48ca', 'a00e66a8-4777-42a6-b31f-1bd107d539f5', '4d7ea552-3125-4249-aad4-530b8c564b9e'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:11:42.885814 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=68,cinder:UPDATE=28,cinder:INSERT=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:43.012001 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9a30c07c-bcf5-4a36-9e20-62fae3e0126c tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:43.116272 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9a30c07c-bcf5-4a36-9e20-62fae3e0126c tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:43.204520 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-9a30c07c-bcf5-4a36-9e20-62fae3e0126c tempest-AttachVolumeTestJSON-1210396921 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:11:43.211005 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9a30c07c-bcf5-4a36-9e20-62fae3e0126c tempest-AttachVolumeTestJSON-1210396921 None] Deleted volume successfully. Jun 04 21:11:43.229511 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-9a30c07c-bcf5-4a36-9e20-62fae3e0126c tempest-AttachVolumeTestJSON-1210396921 None] Lock "b'cinder-14d67208-c233-4663-b9a2-c40b86117130-delete_volume'" released by "delete_volume" :: held 1.621s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:11:43.689872 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-734884d6-1f75-490c-8676-2153357913f0 tempest-VolumesBackupsAdminTest-568448284 None] Lock "b'cinder-7e9d9094-78d3-4f3f-826d-3c231fb9e91e-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:11:43.777050 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-734884d6-1f75-490c-8676-2153357913f0 tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:44.825367 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-734884d6-1f75-490c-8676-2153357913f0 tempest-VolumesBackupsAdminTest-568448284 None] Volume volume-7e9d9094-78d3-4f3f-826d-3c231fb9e91e is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:11:44.935393 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-734884d6-1f75-490c-8676-2153357913f0 tempest-VolumesBackupsAdminTest-568448284 None] deleting rbd volume volume-7e9d9094-78d3-4f3f-826d-3c231fb9e91e {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:11:44.982217 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c4055b49-7c48-4f25-945e-396730d00f42 tempest-AttachVolumeTestJSON-1210396921 None] Lock "b'cinder-26d9f5fb-fdb4-420b-a47f-80c005582589-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:11:45.072400 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c4055b49-7c48-4f25-945e-396730d00f42 tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:45.166084 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c4055b49-7c48-4f25-945e-396730d00f42 tempest-AttachVolumeTestJSON-1210396921 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:11:45.166664 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c4055b49-7c48-4f25-945e-396730d00f42 tempest-AttachVolumeTestJSON-1210396921 None] Volume volume-26d9f5fb-fdb4-420b-a47f-80c005582589 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:11:45.197117 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c4055b49-7c48-4f25-945e-396730d00f42 tempest-AttachVolumeTestJSON-1210396921 None] deleting rbd volume volume-26d9f5fb-fdb4-420b-a47f-80c005582589 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:11:45.334282 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:11:45.336523 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:45.447246 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:45.597140 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:11:46.063924 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-734884d6-1f75-490c-8676-2153357913f0 tempest-VolumesBackupsAdminTest-568448284 None] Created reservations ['f80950a2-bb49-4f9c-840e-26008d219f4f', '1f33173d-2c03-4d07-8c84-54185a23184d', 'c19478a0-d1c9-4503-b55a-b02000008b77', '27db200d-5c6b-46d6-878e-421f10fa308e'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:11:46.095082 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=73,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:46.141915 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-734884d6-1f75-490c-8676-2153357913f0 tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:46.219653 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-734884d6-1f75-490c-8676-2153357913f0 tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:46.298532 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-734884d6-1f75-490c-8676-2153357913f0 tempest-VolumesBackupsAdminTest-568448284 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:11:46.315676 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-734884d6-1f75-490c-8676-2153357913f0 tempest-VolumesBackupsAdminTest-568448284 None] Deleted volume successfully. Jun 04 21:11:46.401656 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-734884d6-1f75-490c-8676-2153357913f0 tempest-VolumesBackupsAdminTest-568448284 None] Lock "b'cinder-7e9d9094-78d3-4f3f-826d-3c231fb9e91e-delete_volume'" released by "delete_volume" :: held 2.712s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:11:46.515423 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-c4055b49-7c48-4f25-945e-396730d00f42 tempest-AttachVolumeTestJSON-1210396921 None] Created reservations ['e9402037-39da-4b0d-aca1-beaabe06a489', '86feb1f1-71c3-444e-86da-60b578197287', 'd6b4ec48-d47e-44fa-962b-1b3c02f9cb40', '0904d0dd-359b-4b42-a406-dbf31b59b978'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:11:46.636149 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c4055b49-7c48-4f25-945e-396730d00f42 tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:46.717367 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c4055b49-7c48-4f25-945e-396730d00f42 tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:46.795568 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-c4055b49-7c48-4f25-945e-396730d00f42 tempest-AttachVolumeTestJSON-1210396921 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:11:46.816324 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c4055b49-7c48-4f25-945e-396730d00f42 tempest-AttachVolumeTestJSON-1210396921 None] Deleted volume successfully. Jun 04 21:11:46.852394 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c4055b49-7c48-4f25-945e-396730d00f42 tempest-AttachVolumeTestJSON-1210396921 None] Lock "b'cinder-26d9f5fb-fdb4-420b-a47f-80c005582589-delete_volume'" released by "delete_volume" :: held 1.868s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:11:47.968756 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-49fc7b18-0699-48cd-bf1f-4bf25b814b29 tempest-AttachVolumeTestJSON-1210396921 None] Lock "b'cinder-95700618-6da4-4410-8224-5fe706fb560d-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:11:48.204807 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-49fc7b18-0699-48cd-bf1f-4bf25b814b29 tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:48.352070 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-49fc7b18-0699-48cd-bf1f-4bf25b814b29 tempest-AttachVolumeTestJSON-1210396921 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:11:48.353479 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-49fc7b18-0699-48cd-bf1f-4bf25b814b29 tempest-AttachVolumeTestJSON-1210396921 None] Volume volume-95700618-6da4-4410-8224-5fe706fb560d is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:11:48.400137 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-49fc7b18-0699-48cd-bf1f-4bf25b814b29 tempest-AttachVolumeTestJSON-1210396921 None] deleting rbd volume volume-95700618-6da4-4410-8224-5fe706fb560d {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:11:48.418360 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:11:48.471576 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Flow 'volume_create_manager' (592a1bdd-c986-4a63-883d-12f5fd53a33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:48.498615 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0880c7b-276b-4199-b5d9-fa296c385a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:48.545505 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0880c7b-276b-4199-b5d9-fa296c385a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-511050411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=45d1c3cf-c968-4934-9075-dfaa9ec59e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3bb2e403511423da10e8427c597ef6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:11:48Z,use_quota=True,user_id='dbc154d4eba04bce8f41de44a97fd257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:48.564280 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d637ecf-65b5-44d2-b2f1-645de8dc73e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:48.576919 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d637ecf-65b5-44d2-b2f1-645de8dc73e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:48.583313 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7301f28-f4e6-48de-b742-b9b47979c645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:48.597807 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7301f28-f4e6-48de-b742-b9b47979c645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d1c3cf-c968-4934-9075-dfaa9ec59e5c', 'volume_name': 'volume-45d1c3cf-c968-4934-9075-dfaa9ec59e5c', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:48.610648 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f40311-0e11-4191-975b-0dc324919d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:48.618704 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f40311-0e11-4191-975b-0dc324919d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:48.629421 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0d27c4-5cd2-4c11-81b7-fda2ff1802f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:48.632623 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Volume 45d1c3cf-c968-4934-9075-dfaa9ec59e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d1c3cf-c968-4934-9075-dfaa9ec59e5c', 'volume_size': 1} Jun 04 21:11:48.633877 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] creating volume 'volume-45d1c3cf-c968-4934-9075-dfaa9ec59e5c' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:11:48.635174 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:48.856194 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:11:48.856975 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:11:48.861103 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0d27c4-5cd2-4c11-81b7-fda2ff1802f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d1c3cf-c968-4934-9075-dfaa9ec59e5c', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:48.876328 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc07a67d-195d-4295-8eca-891936801269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:11:48.906636 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Volume volume-45d1c3cf-c968-4934-9075-dfaa9ec59e5c (45d1c3cf-c968-4934-9075-dfaa9ec59e5c): created successfully Jun 04 21:11:48.914553 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc07a67d-195d-4295-8eca-891936801269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:11:48.922922 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Flow 'volume_create_manager' (592a1bdd-c986-4a63-883d-12f5fd53a33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:11:48.950748 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-5a9275e8-fe69-42fb-9fe7-7922ae9a59e4 tempest-VolumesBackupsAdminTest-568448284 None] Created volume successfully. Jun 04 21:11:49.552899 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-32d0eaec-44cc-471c-9b6f-79b8b4856525 tempest-VolumesBackupsAdminTest-568448284 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-04T21:11:49Z,data_timestamp=2022-06-04T21:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-285076486',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=c5d30e1f-7489-418f-950a-e000dc5341fc,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d3bb2e403511423da10e8427c597ef6d',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='dbc154d4eba04bce8f41de44a97fd257',volume_id=45d1c3cf-c968-4934-9075-dfaa9ec59e5c) Jun 04 21:11:49.555619 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.backup.rpcapi [None req-32d0eaec-44cc-471c-9b6f-79b8b4856525 tempest-VolumesBackupsAdminTest-568448284 None] continue_backup in rpcapi backup_id c5d30e1f-7489-418f-950a-e000dc5341fc {{(pid=130490) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 04 21:11:49.576533 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-49fc7b18-0699-48cd-bf1f-4bf25b814b29 tempest-AttachVolumeTestJSON-1210396921 None] Created reservations ['165fbba0-2d46-4b27-a181-d3b662ca47e4', 'd0234593-22c8-4935-b07a-c50bbea64bfc', 'c0deb06c-81c0-4c74-89bd-82bc037a1a52', 'f93b65cd-8dee-4f34-94b4-7a93df8b01ff'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:11:49.739211 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=41,cinder:DELETE=4,cinder:SELECT=50,cinder:INSERT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:49.756697 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-49fc7b18-0699-48cd-bf1f-4bf25b814b29 tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:49.848769 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-49fc7b18-0699-48cd-bf1f-4bf25b814b29 tempest-AttachVolumeTestJSON-1210396921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:49.925090 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-49fc7b18-0699-48cd-bf1f-4bf25b814b29 tempest-AttachVolumeTestJSON-1210396921 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:11:49.934043 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-49fc7b18-0699-48cd-bf1f-4bf25b814b29 tempest-AttachVolumeTestJSON-1210396921 None] Deleted volume successfully. Jun 04 21:11:49.962611 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-49fc7b18-0699-48cd-bf1f-4bf25b814b29 tempest-AttachVolumeTestJSON-1210396921 None] Lock "b'cinder-95700618-6da4-4410-8224-5fe706fb560d-delete_volume'" released by "delete_volume" :: held 1.993s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:11:49.982905 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-32d0eaec-44cc-471c-9b6f-79b8b4856525 tempest-VolumesBackupsAdminTest-568448284 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:11:51.170001 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-32d0eaec-44cc-471c-9b6f-79b8b4856525 tempest-VolumesBackupsAdminTest-568448284 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.187s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:11:51.171634 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32d0eaec-44cc-471c-9b6f-79b8b4856525 tempest-VolumesBackupsAdminTest-568448284 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-45d1c3cf-c968-4934-9075-dfaa9ec59e5c', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '45d1c3cf-c968-4934-9075-dfaa9ec59e5c', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:11:51.239557 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-32d0eaec-44cc-471c-9b6f-79b8b4856525 tempest-VolumesBackupsAdminTest-568448284 None] Initialize volume connection completed successfully. Jun 04 21:11:54.296475 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-32d0eaec-44cc-471c-9b6f-79b8b4856525 tempest-VolumesBackupsAdminTest-568448284 None] Terminate volume connection completed successfully. Jun 04 21:11:54.343388 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-32d0eaec-44cc-471c-9b6f-79b8b4856525 tempest-VolumesBackupsAdminTest-568448284 None] Remove volume export completed successfully. Jun 04 21:11:57.364494 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d53fdd55-880f-4bda-9588-1d1137c2e30d tempest-VolumesBackupsAdminTest-568448284 None] Lock "b'cinder-45d1c3cf-c968-4934-9075-dfaa9ec59e5c-delete_volume'" acquired by "delete_volume" :: waited 0.061s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:11:57.492863 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d53fdd55-880f-4bda-9588-1d1137c2e30d tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:58.616349 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d53fdd55-880f-4bda-9588-1d1137c2e30d tempest-VolumesBackupsAdminTest-568448284 None] Volume volume-45d1c3cf-c968-4934-9075-dfaa9ec59e5c is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:11:58.717237 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d53fdd55-880f-4bda-9588-1d1137c2e30d tempest-VolumesBackupsAdminTest-568448284 None] deleting rbd volume volume-45d1c3cf-c968-4934-9075-dfaa9ec59e5c {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:11:59.574016 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-d53fdd55-880f-4bda-9588-1d1137c2e30d tempest-VolumesBackupsAdminTest-568448284 None] Created reservations ['09312733-58a9-476e-b368-8815fc1bee02', '4e800ab2-b433-44ef-9ac9-b4a03aef058a', '47d7ec37-83ee-41be-9b50-d7fa173fca60', '290ace3f-1f3e-446a-aac1-13654c6639de'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:11:59.749941 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d53fdd55-880f-4bda-9588-1d1137c2e30d tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:59.840344 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d53fdd55-880f-4bda-9588-1d1137c2e30d tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:11:59.902210 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-d53fdd55-880f-4bda-9588-1d1137c2e30d tempest-VolumesBackupsAdminTest-568448284 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:11:59.915225 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-d53fdd55-880f-4bda-9588-1d1137c2e30d tempest-VolumesBackupsAdminTest-568448284 None] Deleted volume successfully. Jun 04 21:11:59.987955 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d53fdd55-880f-4bda-9588-1d1137c2e30d tempest-VolumesBackupsAdminTest-568448284 None] Lock "b'cinder-45d1c3cf-c968-4934-9075-dfaa9ec59e5c-delete_volume'" released by "delete_volume" :: held 2.624s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:12:00.925177 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0d8b0195-cdb3-4e28-b361-2d80664aa0a3 tempest-VolumesBackupsAdminTest-568448284 None] Lock "b'cinder-795f6f6e-5d43-4bb4-8d7d-b2684b160d70-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:12:01.045771 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d8b0195-cdb3-4e28-b361-2d80664aa0a3 tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:01.697346 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d8b0195-cdb3-4e28-b361-2d80664aa0a3 tempest-VolumesBackupsAdminTest-568448284 None] Volume volume-795f6f6e-5d43-4bb4-8d7d-b2684b160d70 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:12:01.731166 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d8b0195-cdb3-4e28-b361-2d80664aa0a3 tempest-VolumesBackupsAdminTest-568448284 None] deleting rbd volume volume-795f6f6e-5d43-4bb4-8d7d-b2684b160d70 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:12:02.440014 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-0d8b0195-cdb3-4e28-b361-2d80664aa0a3 tempest-VolumesBackupsAdminTest-568448284 None] Created reservations ['d5555bbb-7e30-40ca-a112-f9af74ad6f24', 'c15973e8-5988-4894-839f-ec2811025e7e', '373a1a5b-b8a1-493e-a122-8053e02df772', 'e89c98b6-c882-4014-a6a6-140392247d98'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:12:02.532927 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d8b0195-cdb3-4e28-b361-2d80664aa0a3 tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:02.579900 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d8b0195-cdb3-4e28-b361-2d80664aa0a3 tempest-VolumesBackupsAdminTest-568448284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:02.654103 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0d8b0195-cdb3-4e28-b361-2d80664aa0a3 tempest-VolumesBackupsAdminTest-568448284 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:12:02.665864 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0d8b0195-cdb3-4e28-b361-2d80664aa0a3 tempest-VolumesBackupsAdminTest-568448284 None] Deleted volume successfully. Jun 04 21:12:02.687997 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0d8b0195-cdb3-4e28-b361-2d80664aa0a3 tempest-VolumesBackupsAdminTest-568448284 None] Lock "b'cinder-795f6f6e-5d43-4bb4-8d7d-b2684b160d70-delete_volume'" released by "delete_volume" :: held 1.762s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:12:11.301613 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:12:11.405527 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Flow 'volume_create_manager' (d93bb83f-531e-4b52-b090-4715edbd116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:12:11.462869 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b19595-6d54-4fab-ae3b-897066b99a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:11.564805 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b19595-6d54-4fab-ae3b-897066b99a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-634517584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7f1b51b7-d174-4858-8336-cdae1daa4ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d95c6f6c7984ac08ef5118ec96da965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:12:11Z,use_quota=True,user_id='3470e522e0f54c29bfe5b6a359d78148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:11.599693 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e3eb0c-4478-4782-80b1-893d40239886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:11.615033 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e3eb0c-4478-4782-80b1-893d40239886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:11.654093 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1bdfbc-fe08-466e-a6a8-c81145453371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:11.675420 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1bdfbc-fe08-466e-a6a8-c81145453371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f1b51b7-d174-4858-8336-cdae1daa4ad2', 'volume_name': 'volume-7f1b51b7-d174-4858-8336-cdae1daa4ad2', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:11.690747 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b9c0eb-4c45-49d3-aa69-ae4b9eceb14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:11.701435 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b9c0eb-4c45-49d3-aa69-ae4b9eceb14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:11.724841 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7f8bbc-caa9-4eea-b9c2-49d84824a983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:11.726185 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Volume 7f1b51b7-d174-4858-8336-cdae1daa4ad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f1b51b7-d174-4858-8336-cdae1daa4ad2', 'volume_size': 1} Jun 04 21:12:11.726578 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] creating volume 'volume-7f1b51b7-d174-4858-8336-cdae1daa4ad2' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:12:11.727373 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:11.996126 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:12:11.996868 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:12:12.002691 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7f8bbc-caa9-4eea-b9c2-49d84824a983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1b51b7-d174-4858-8336-cdae1daa4ad2', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:12.025797 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ec6e2c-5da7-40db-9016-0caa5936f0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:12.045567 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Volume volume-7f1b51b7-d174-4858-8336-cdae1daa4ad2 (7f1b51b7-d174-4858-8336-cdae1daa4ad2): created successfully Jun 04 21:12:12.050898 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ec6e2c-5da7-40db-9016-0caa5936f0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:12.071716 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Flow 'volume_create_manager' (d93bb83f-531e-4b52-b090-4715edbd116c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:12:12.107648 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a41c22b8-337c-41bb-a049-a5725393e1b3 tempest-AbsoluteLimitsTests-710325797 None] Created volume successfully. Jun 04 21:12:12.111011 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=57,cinder:INSERT=6,cinder:UPDATE=35,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:12.623181 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-1e217286-edf5-4480-97b8-ab4d466f3d6c tempest-AbsoluteLimitsTests-710325797 None] Lock "b'cinder-7f1b51b7-d174-4858-8336-cdae1daa4ad2-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:12:12.725737 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1e217286-edf5-4480-97b8-ab4d466f3d6c tempest-AbsoluteLimitsTests-710325797 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:12.891770 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1e217286-edf5-4480-97b8-ab4d466f3d6c tempest-AbsoluteLimitsTests-710325797 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:12:12.893244 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1e217286-edf5-4480-97b8-ab4d466f3d6c tempest-AbsoluteLimitsTests-710325797 None] Volume volume-7f1b51b7-d174-4858-8336-cdae1daa4ad2 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:12:12.912044 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1e217286-edf5-4480-97b8-ab4d466f3d6c tempest-AbsoluteLimitsTests-710325797 None] deleting rbd volume volume-7f1b51b7-d174-4858-8336-cdae1daa4ad2 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:12:13.899565 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-1e217286-edf5-4480-97b8-ab4d466f3d6c tempest-AbsoluteLimitsTests-710325797 None] Created reservations ['1dfcec21-eb81-40dd-83ee-b982853796ca', '5c179891-0bca-4926-a79f-38c3a715094d', 'cc0db8cc-74a0-439b-a5cd-d0bfbde8b8fe', '1e2635e4-66cd-4e64-835b-5bf00d18e97b'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:12:14.023940 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1e217286-edf5-4480-97b8-ab4d466f3d6c tempest-AbsoluteLimitsTests-710325797 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:14.104942 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1e217286-edf5-4480-97b8-ab4d466f3d6c tempest-AbsoluteLimitsTests-710325797 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:14.178020 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-1e217286-edf5-4480-97b8-ab4d466f3d6c tempest-AbsoluteLimitsTests-710325797 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:12:14.211628 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1e217286-edf5-4480-97b8-ab4d466f3d6c tempest-AbsoluteLimitsTests-710325797 None] Deleted volume successfully. Jun 04 21:12:14.262449 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-1e217286-edf5-4480-97b8-ab4d466f3d6c tempest-AbsoluteLimitsTests-710325797 None] Lock "b'cinder-7f1b51b7-d174-4858-8336-cdae1daa4ad2-delete_volume'" released by "delete_volume" :: held 1.640s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:12:24.965594 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=49,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:44.961198 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=18,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:45.339862 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:12:45.343733 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:45.432967 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:45.511837 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:12:46.275024 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:12:46.322436 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Flow 'volume_create_manager' (72ddc794-e3cb-46a6-ab69-cb715105cb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:12:46.329675 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbd1624-c4de-440a-8e47-ce15ee2f9df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:46.372102 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbd1624-c4de-440a-8e47-ce15ee2f9df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-426335110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=36780f22-a7fb-4b14-944e-832b14ab0650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb222a5b84448e49efb0ffffc35b928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:12:46Z,use_quota=True,user_id='477aa1f663c440a496dcc85d31b2310e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:46.388141 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10adc9e0-ea21-465d-91af-1717b6596f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:46.393742 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10adc9e0-ea21-465d-91af-1717b6596f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:46.402612 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5958349-cee0-469a-9dd1-f3c1af46b5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:46.416284 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5958349-cee0-469a-9dd1-f3c1af46b5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36780f22-a7fb-4b14-944e-832b14ab0650', 'volume_name': 'volume-36780f22-a7fb-4b14-944e-832b14ab0650', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:46.431793 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1468273f-9a72-4406-bc92-9bc2363ebb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:46.442343 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1468273f-9a72-4406-bc92-9bc2363ebb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:46.450638 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f1c4de-650d-408e-b2d7-e7a7adc5f07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:46.456947 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Volume 36780f22-a7fb-4b14-944e-832b14ab0650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36780f22-a7fb-4b14-944e-832b14ab0650', 'volume_size': 1} Jun 04 21:12:46.457378 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] creating volume 'volume-36780f22-a7fb-4b14-944e-832b14ab0650' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:12:46.458178 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:46.603883 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:12:46.604352 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:12:46.609253 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f1c4de-650d-408e-b2d7-e7a7adc5f07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36780f22-a7fb-4b14-944e-832b14ab0650', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:46.618674 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc99a64e-08c0-419f-97c8-a104983fa18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:46.638519 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Volume volume-36780f22-a7fb-4b14-944e-832b14ab0650 (36780f22-a7fb-4b14-944e-832b14ab0650): created successfully Jun 04 21:12:46.644869 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc99a64e-08c0-419f-97c8-a104983fa18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:46.656103 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Flow 'volume_create_manager' (72ddc794-e3cb-46a6-ab69-cb715105cb03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:12:46.678152 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-47748775-3670-42fd-b4dc-9cec1176b755 tempest-VolumeQuotasAdminTestJSON-60414155 None] Created volume successfully. Jun 04 21:12:47.351685 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-8eff83e8-15c6-4e37-8c66-86d592411c38 tempest-VolumeQuotasAdminTestJSON-60414155 None] Lock "b'cinder-36780f22-a7fb-4b14-944e-832b14ab0650-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:12:47.425499 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8eff83e8-15c6-4e37-8c66-86d592411c38 tempest-VolumeQuotasAdminTestJSON-60414155 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:47.521518 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8eff83e8-15c6-4e37-8c66-86d592411c38 tempest-VolumeQuotasAdminTestJSON-60414155 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:12:47.521962 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8eff83e8-15c6-4e37-8c66-86d592411c38 tempest-VolumeQuotasAdminTestJSON-60414155 None] Volume volume-36780f22-a7fb-4b14-944e-832b14ab0650 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:12:47.535440 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8eff83e8-15c6-4e37-8c66-86d592411c38 tempest-VolumeQuotasAdminTestJSON-60414155 None] deleting rbd volume volume-36780f22-a7fb-4b14-944e-832b14ab0650 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:12:48.119746 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-8eff83e8-15c6-4e37-8c66-86d592411c38 tempest-VolumeQuotasAdminTestJSON-60414155 None] Created reservations ['c96f8b35-8939-48da-8ff2-ee9a0a6880f1', '4effb4bf-64db-4beb-b39d-2704aa92d5db', '216c762c-32c8-49a9-97f6-f017a2023a73', '12a98ec4-35ee-4864-832a-0046a6b91607'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:12:48.195143 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8eff83e8-15c6-4e37-8c66-86d592411c38 tempest-VolumeQuotasAdminTestJSON-60414155 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:48.311829 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8eff83e8-15c6-4e37-8c66-86d592411c38 tempest-VolumeQuotasAdminTestJSON-60414155 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:48.425691 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-8eff83e8-15c6-4e37-8c66-86d592411c38 tempest-VolumeQuotasAdminTestJSON-60414155 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:12:48.493877 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8eff83e8-15c6-4e37-8c66-86d592411c38 tempest-VolumeQuotasAdminTestJSON-60414155 None] Deleted volume successfully. Jun 04 21:12:48.521774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-8eff83e8-15c6-4e37-8c66-86d592411c38 tempest-VolumeQuotasAdminTestJSON-60414155 None] Lock "b'cinder-36780f22-a7fb-4b14-944e-832b14ab0650-delete_volume'" released by "delete_volume" :: held 1.170s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:12:49.392178 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:12:49.433615 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Flow 'volume_create_manager' (1c368941-03bb-4d3c-8b2b-cacb398f14fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:12:49.450831 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4f763b-b854-4698-9811-10c50feea157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:49.490307 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4f763b-b854-4698-9811-10c50feea157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-443656184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4d500ea7-3c5d-44a5-ab41-a73f3019c990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb222a5b84448e49efb0ffffc35b928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:12:49Z,use_quota=True,user_id='477aa1f663c440a496dcc85d31b2310e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:49.508556 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a609c9-83bd-483b-93d6-efb37f78d129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:49.515428 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a609c9-83bd-483b-93d6-efb37f78d129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:49.531032 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a32ac8-f92e-4dea-9634-390bb23e75ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:49.538956 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a32ac8-f92e-4dea-9634-390bb23e75ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d500ea7-3c5d-44a5-ab41-a73f3019c990', 'volume_name': 'volume-4d500ea7-3c5d-44a5-ab41-a73f3019c990', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:49.550359 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dde17c-b348-4e77-afb0-b554b13eb85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:49.556686 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dde17c-b348-4e77-afb0-b554b13eb85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:49.568873 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b079ae6-8314-4d87-a9d9-d8bee991c7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:49.575822 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Volume 4d500ea7-3c5d-44a5-ab41-a73f3019c990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d500ea7-3c5d-44a5-ab41-a73f3019c990', 'volume_size': 1} Jun 04 21:12:49.578035 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] creating volume 'volume-4d500ea7-3c5d-44a5-ab41-a73f3019c990' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:12:49.579406 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:49.781237 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:12:49.781620 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:12:49.786048 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b079ae6-8314-4d87-a9d9-d8bee991c7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d500ea7-3c5d-44a5-ab41-a73f3019c990', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:49.795217 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd66489-4b05-48f0-9559-da8d1ced2249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:12:49.816604 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Volume volume-4d500ea7-3c5d-44a5-ab41-a73f3019c990 (4d500ea7-3c5d-44a5-ab41-a73f3019c990): created successfully Jun 04 21:12:49.821496 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd66489-4b05-48f0-9559-da8d1ced2249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:12:49.827799 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Flow 'volume_create_manager' (1c368941-03bb-4d3c-8b2b-cacb398f14fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:12:49.854230 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-267ef4da-ddc1-4b1f-9f42-642c29cf5a0d tempest-VolumeQuotasAdminTestJSON-60414155 None] Created volume successfully. Jun 04 21:12:52.225178 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9e6ddeac-a570-45af-9522-e490bb27b65f tempest-VolumeQuotasAdminTestJSON-1299568377 None] Transfer volume completed successfully. Jun 04 21:12:53.079845 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-eba4d30c-67d9-4d29-a77b-08b333818f0c tempest-VolumeQuotasAdminTestJSON-32576788 None] Lock "b'cinder-4d500ea7-3c5d-44a5-ab41-a73f3019c990-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:12:53.132221 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-eba4d30c-67d9-4d29-a77b-08b333818f0c tempest-VolumeQuotasAdminTestJSON-32576788 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:53.233474 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-eba4d30c-67d9-4d29-a77b-08b333818f0c tempest-VolumeQuotasAdminTestJSON-32576788 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:12:53.234657 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-eba4d30c-67d9-4d29-a77b-08b333818f0c tempest-VolumeQuotasAdminTestJSON-32576788 None] Volume volume-4d500ea7-3c5d-44a5-ab41-a73f3019c990 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:12:53.257923 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-eba4d30c-67d9-4d29-a77b-08b333818f0c tempest-VolumeQuotasAdminTestJSON-32576788 None] deleting rbd volume volume-4d500ea7-3c5d-44a5-ab41-a73f3019c990 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:12:53.806525 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-eba4d30c-67d9-4d29-a77b-08b333818f0c tempest-VolumeQuotasAdminTestJSON-32576788 None] Created reservations ['2a57587d-aa78-486e-939b-c21a3d1021fa', 'b8b447c8-accd-4f1a-b990-3d82d209c42e', '5fdca874-4067-4822-8ce6-c0f2cc99bc90', '55d8d740-466e-4d14-94af-596933a2a5dc'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:12:53.899553 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-eba4d30c-67d9-4d29-a77b-08b333818f0c tempest-VolumeQuotasAdminTestJSON-32576788 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:54.001200 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-eba4d30c-67d9-4d29-a77b-08b333818f0c tempest-VolumeQuotasAdminTestJSON-32576788 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:12:54.065285 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-eba4d30c-67d9-4d29-a77b-08b333818f0c tempest-VolumeQuotasAdminTestJSON-32576788 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:12:54.079119 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-eba4d30c-67d9-4d29-a77b-08b333818f0c tempest-VolumeQuotasAdminTestJSON-32576788 None] Deleted volume successfully. Jun 04 21:12:54.100471 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-eba4d30c-67d9-4d29-a77b-08b333818f0c tempest-VolumeQuotasAdminTestJSON-32576788 None] Lock "b'cinder-4d500ea7-3c5d-44a5-ab41-a73f3019c990-delete_volume'" released by "delete_volume" :: held 1.021s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:13:04.964584 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=37,cinder:UPDATE=18,cinder:INSERT=8 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:05.870194 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:13:05.936159 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Flow 'volume_create_manager' (4c99b642-c109-4aa0-8ba4-a7f017110061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:13:05.955094 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6807e5-90b0-49b4-95a4-76bc918b2806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:06.024033 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6807e5-90b0-49b4-95a4-76bc918b2806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1219611781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a8f6bf14-0b51-4376-9348-3fd2dc76978c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c3f759fbde4b209d7d15ae2d262603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:13:06Z,use_quota=True,user_id='6aac9857ea644526845c71b5ff77e327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:06.030933 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21280dd7-d850-4e89-9ede-94e74ff2210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:06.036297 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21280dd7-d850-4e89-9ede-94e74ff2210d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:06.053329 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928d1ac0-bb27-4d58-bae1-4719fb5defed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:06.057782 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928d1ac0-bb27-4d58-bae1-4719fb5defed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f6bf14-0b51-4376-9348-3fd2dc76978c', 'volume_name': 'volume-a8f6bf14-0b51-4376-9348-3fd2dc76978c', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:06.078153 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8cb4ea-b178-42c5-9cb9-0ca9884187d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:06.078153 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8cb4ea-b178-42c5-9cb9-0ca9884187d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:06.084223 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588f6199-6f7d-452d-8d73-c7b447e4d612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:06.088760 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Volume a8f6bf14-0b51-4376-9348-3fd2dc76978c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f6bf14-0b51-4376-9348-3fd2dc76978c', 'volume_size': 1} Jun 04 21:13:06.089492 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] creating volume 'volume-a8f6bf14-0b51-4376-9348-3fd2dc76978c' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:13:06.091150 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:06.212607 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:13:06.213080 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:13:06.216749 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588f6199-6f7d-452d-8d73-c7b447e4d612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f6bf14-0b51-4376-9348-3fd2dc76978c', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:06.229230 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69489f6c-bb50-4dfd-bd74-d106fed53293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:06.261547 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Volume volume-a8f6bf14-0b51-4376-9348-3fd2dc76978c (a8f6bf14-0b51-4376-9348-3fd2dc76978c): created successfully Jun 04 21:13:06.265697 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69489f6c-bb50-4dfd-bd74-d106fed53293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:06.287354 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Flow 'volume_create_manager' (4c99b642-c109-4aa0-8ba4-a7f017110061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:13:06.316749 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8c095423-c73d-4987-933e-1f148ae5a543 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Created volume successfully. Jun 04 21:13:08.298532 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-9b302c38-e594-471c-b0d0-7ec231955955 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Lock "b'cinder-a8f6bf14-0b51-4376-9348-3fd2dc76978c-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:13:08.409807 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9b302c38-e594-471c-b0d0-7ec231955955 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:08.548146 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9b302c38-e594-471c-b0d0-7ec231955955 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:13:08.548814 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9b302c38-e594-471c-b0d0-7ec231955955 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Volume volume-a8f6bf14-0b51-4376-9348-3fd2dc76978c is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:13:08.558487 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9b302c38-e594-471c-b0d0-7ec231955955 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] deleting rbd volume volume-a8f6bf14-0b51-4376-9348-3fd2dc76978c {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:13:09.094202 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-9b302c38-e594-471c-b0d0-7ec231955955 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Created reservations ['634b3418-88e1-4ba1-883d-e989dd61a343', '84e4b21e-caeb-4e8e-b413-c9d654ff94b9', '87a1454b-d2e9-46ec-aac2-6122ed8892e0', '5b7199c7-2da4-4a20-ab01-e7de9e910d33'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:13:09.197393 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9b302c38-e594-471c-b0d0-7ec231955955 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:09.315337 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9b302c38-e594-471c-b0d0-7ec231955955 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:09.392487 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-9b302c38-e594-471c-b0d0-7ec231955955 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:13:09.398399 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9b302c38-e594-471c-b0d0-7ec231955955 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Deleted volume successfully. Jun 04 21:13:09.418660 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-9b302c38-e594-471c-b0d0-7ec231955955 tempest-VolumeQuotasNegativeTestJSON-1926314958 None] Lock "b'cinder-a8f6bf14-0b51-4376-9348-3fd2dc76978c-delete_volume'" released by "delete_volume" :: held 1.120s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:13:17.602756 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=55,cinder:UPDATE=35,cinder:DELETE=4,cinder:INSERT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:17.625400 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:13:17.656352 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Flow 'volume_create_manager' (6d52ebd7-931d-40e3-96d9-b2dec7b34d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:13:17.663215 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b56da8-a9b4-4046-8f6c-cd1cbd7769e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:17.686522 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b56da8-a9b4-4046-8f6c-cd1cbd7769e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-515945630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=11b8f3bc-799b-47ba-ac4f-bc3b622efb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4308ccec58d4b9cb14c106d7ceb5c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:13:18Z,use_quota=True,user_id='9d0faa838a4e4aa9bc003ece07247ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:17.692513 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d2dda4-c959-4e5e-a688-e9250b204d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:17.696702 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d2dda4-c959-4e5e-a688-e9250b204d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:17.701616 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c527ef8-d059-4a52-9d50-96a68c8c5bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:17.705509 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c527ef8-d059-4a52-9d50-96a68c8c5bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b8f3bc-799b-47ba-ac4f-bc3b622efb89', 'volume_name': 'volume-11b8f3bc-799b-47ba-ac4f-bc3b622efb89', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:17.710524 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe46f712-82d6-4572-83ff-5dcc5e8b8bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:17.714523 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe46f712-82d6-4572-83ff-5dcc5e8b8bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:17.719236 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f105fdf-52a2-4ff5-9afe-253dc8f817e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:17.720547 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Volume 11b8f3bc-799b-47ba-ac4f-bc3b622efb89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b8f3bc-799b-47ba-ac4f-bc3b622efb89', 'volume_size': 1} Jun 04 21:13:17.720941 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] creating volume 'volume-11b8f3bc-799b-47ba-ac4f-bc3b622efb89' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:13:17.721713 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:17.821021 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:13:17.821367 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:13:17.825010 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f105fdf-52a2-4ff5-9afe-253dc8f817e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b8f3bc-799b-47ba-ac4f-bc3b622efb89', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:17.836328 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1956e3-6ba3-4355-854d-c81e79b1a6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:17.849285 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Volume volume-11b8f3bc-799b-47ba-ac4f-bc3b622efb89 (11b8f3bc-799b-47ba-ac4f-bc3b622efb89): created successfully Jun 04 21:13:17.855314 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1956e3-6ba3-4355-854d-c81e79b1a6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:17.862387 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Flow 'volume_create_manager' (6d52ebd7-931d-40e3-96d9-b2dec7b34d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:13:17.877313 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-6abe0599-acde-4f54-9f3b-00b04bf97939 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Created volume successfully. Jun 04 21:13:19.113049 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2a84bab4-b431-4278-8db7-55fb5ec9e7fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:19.855808 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2a84bab4-b431-4278-8db7-55fb5ec9e7fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Create snapshot completed successfully Jun 04 21:13:20.701505 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2c30d90f-9d01-433f-b749-df020794d867 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Lock "b'cinder-ff771d98-9d1f-4c16-a21c-c7e878d87461-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:13:20.705354 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2c30d90f-9d01-433f-b749-df020794d867 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:21.899364 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-2c30d90f-9d01-433f-b749-df020794d867 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Created reservations ['c2002642-db9e-4316-b534-21bd8c1b9bd0', '1e000a57-4020-402c-a95a-c0ac0cf34d82', 'fe7e92b1-25b8-4602-81e6-19355624107a', 'a584b924-4982-4b4d-b305-34045a293063'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:13:21.984497 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2c30d90f-9d01-433f-b749-df020794d867 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Delete snapshot completed successfully. Jun 04 21:13:21.997438 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2c30d90f-9d01-433f-b749-df020794d867 tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Lock "b'cinder-ff771d98-9d1f-4c16-a21c-c7e878d87461-delete_snapshot'" released by "delete_snapshot" :: held 1.296s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:13:22.994492 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-91b05354-f3c5-4ce3-9efc-c5157d6492dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Lock "b'cinder-11b8f3bc-799b-47ba-ac4f-bc3b622efb89-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:13:23.060342 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-91b05354-f3c5-4ce3-9efc-c5157d6492dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:23.150533 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-91b05354-f3c5-4ce3-9efc-c5157d6492dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:13:23.151019 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-91b05354-f3c5-4ce3-9efc-c5157d6492dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Volume volume-11b8f3bc-799b-47ba-ac4f-bc3b622efb89 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:13:23.160254 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-91b05354-f3c5-4ce3-9efc-c5157d6492dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] deleting rbd volume volume-11b8f3bc-799b-47ba-ac4f-bc3b622efb89 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:13:23.632350 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-91b05354-f3c5-4ce3-9efc-c5157d6492dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Created reservations ['aebd7b2c-1148-43a1-af16-081302039b50', '4f144e96-ee0d-4181-9279-bfc829c883fd', '0d38831a-3c07-4444-aa90-5bbfecb5fda9', '4ad0d6c9-2b04-4fc5-8b79-bf89458130f1'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:13:23.718046 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-91b05354-f3c5-4ce3-9efc-c5157d6492dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:23.793838 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-91b05354-f3c5-4ce3-9efc-c5157d6492dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:23.858093 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-91b05354-f3c5-4ce3-9efc-c5157d6492dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:13:23.862405 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-91b05354-f3c5-4ce3-9efc-c5157d6492dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Deleted volume successfully. Jun 04 21:13:23.882459 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-91b05354-f3c5-4ce3-9efc-c5157d6492dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1006412400 None] Lock "b'cinder-11b8f3bc-799b-47ba-ac4f-bc3b622efb89-delete_volume'" released by "delete_volume" :: held 0.888s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:13:33.868437 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=45,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=9 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:34.971277 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=32,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:45.344752 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:13:45.345542 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:45.449900 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:45.549178 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:13:46.636095 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:13:46.685592 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Flow 'volume_create_manager' (0f0814c0-4a25-4e0f-b00b-12bd0d9214bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:13:46.697645 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d42e14-73ed-48c0-9732-f3822a10571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:46.729424 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d42e14-73ed-48c0-9732-f3822a10571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1865565292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5b2e23f7-37ef-436d-b587-020bdcf55af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f7eafafd554647ad42646ebdc1aa1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:13:47Z,use_quota=True,user_id='2ed5143e191a43cc892a9428a2a8376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:46.736964 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6002d2-0f7c-4e07-9b15-a73b67e9c8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:46.743752 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6002d2-0f7c-4e07-9b15-a73b67e9c8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:46.751828 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58130ae-bc2d-4557-afc6-2f7570157785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:46.885970 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58130ae-bc2d-4557-afc6-2f7570157785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b2e23f7-37ef-436d-b587-020bdcf55af8', 'volume_name': 'volume-5b2e23f7-37ef-436d-b587-020bdcf55af8', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:46.906336 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4341f3-08bc-474d-9ce0-e8a220160d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:46.910553 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4341f3-08bc-474d-9ce0-e8a220160d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:46.920182 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77143bcd-a569-4285-9c5b-44639ae077aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:46.921371 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Volume 5b2e23f7-37ef-436d-b587-020bdcf55af8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b2e23f7-37ef-436d-b587-020bdcf55af8', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:13:46.922084 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Cloning 5b2e23f7-37ef-436d-b587-020bdcf55af8 from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:13:46.946918 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:13:46.976652 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 13, 46, 960028)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:13:46.977248 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:13:46.977727 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:13:46.988485 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.037s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:13:46.991163 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:13:47.006135 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 13, 47, 56)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:13:47.008207 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:13:47.008945 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:13:47.042388 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:47.198261 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] creating snapshot='volume-5b2e23f7-37ef-436d-b587-020bdcf55af8.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:13:47.631181 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-5b2e23f7-37ef-436d-b587-020bdcf55af8.clone_snap' to 'volume-5b2e23f7-37ef-436d-b587-020bdcf55af8' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:13:47.885188 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:13:47.887619 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:13:47.888463 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:13:47.943096 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:13:47.943872 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Marking volume 5b2e23f7-37ef-436d-b587-020bdcf55af8 as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:13:47.957024 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 5b2e23f7-37ef-436d-b587-020bdcf55af8. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:13:47.957834 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Creating volume glance metadata for volume 5b2e23f7-37ef-436d-b587-020bdcf55af8 backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:13:48.035862 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77143bcd-a569-4285-9c5b-44639ae077aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2e23f7-37ef-436d-b587-020bdcf55af8', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:48.040902 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222dab90-6db2-4d6d-b6c8-5a51d16e3e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:48.053135 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Volume volume-5b2e23f7-37ef-436d-b587-020bdcf55af8 (5b2e23f7-37ef-436d-b587-020bdcf55af8): created successfully Jun 04 21:13:48.061706 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222dab90-6db2-4d6d-b6c8-5a51d16e3e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:48.071826 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Flow 'volume_create_manager' (0f0814c0-4a25-4e0f-b00b-12bd0d9214bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:13:48.088354 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0d810eb2-700f-47dc-bf40-4726cdba7c05 tempest-TestVolumeBackupRestore-633667600 None] Created volume successfully. Jun 04 21:13:49.432350 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4183aaf4-5b8e-4dd6-8c93-9deccd381912 tempest-TestVolumeBackupRestore-633667600 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-04T21:13:49Z,data_timestamp=2022-06-04T21:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=a91f2a80-881b-42e6-9584-0e8a17178049,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a6f7eafafd554647ad42646ebdc1aa1b',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='2ed5143e191a43cc892a9428a2a8376c',volume_id=5b2e23f7-37ef-436d-b587-020bdcf55af8) Jun 04 21:13:49.434424 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.backup.rpcapi [None req-4183aaf4-5b8e-4dd6-8c93-9deccd381912 tempest-TestVolumeBackupRestore-633667600 None] continue_backup in rpcapi backup_id a91f2a80-881b-42e6-9584-0e8a17178049 {{(pid=130490) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 04 21:13:49.698206 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-4183aaf4-5b8e-4dd6-8c93-9deccd381912 tempest-TestVolumeBackupRestore-633667600 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:13:50.793190 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-4183aaf4-5b8e-4dd6-8c93-9deccd381912 tempest-TestVolumeBackupRestore-633667600 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.097s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:13:50.796624 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4183aaf4-5b8e-4dd6-8c93-9deccd381912 tempest-TestVolumeBackupRestore-633667600 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5b2e23f7-37ef-436d-b587-020bdcf55af8', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '5b2e23f7-37ef-436d-b587-020bdcf55af8', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:13:50.824516 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4183aaf4-5b8e-4dd6-8c93-9deccd381912 tempest-TestVolumeBackupRestore-633667600 None] Initialize volume connection completed successfully. Jun 04 21:13:58.634681 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:13:58.661261 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (425d3efd-ceff-4762-ab96-87b93af9e1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:13:58.668484 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d69cba7-c1bd-4c49-8f7b-a335e34f81e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:58.692336 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d69cba7-c1bd-4c49-8f7b-a335e34f81e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-382757201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d9a0b59f-79a5-480d-9a3f-0228e67133c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f970c3882e940f98bab811c9fdd078a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:13:59Z,use_quota=True,user_id='4eccde33e4f44565b9e7ed25ba378948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:58.698312 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4fa8bcf-0606-4e49-8bde-d3228569dc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:58.702993 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4fa8bcf-0606-4e49-8bde-d3228569dc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:58.709215 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6d66a4-a8de-46ce-9929-147a02affdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:58.714085 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6d66a4-a8de-46ce-9929-147a02affdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a0b59f-79a5-480d-9a3f-0228e67133c5', 'volume_name': 'volume-d9a0b59f-79a5-480d-9a3f-0228e67133c5', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:58.719521 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b651e9c3-9dec-4f7a-aa1d-46a8baf6f5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:58.724312 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b651e9c3-9dec-4f7a-aa1d-46a8baf6f5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:58.736915 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c668a764-a5d6-4a5b-9e49-905bf34ea033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:58.738456 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Volume d9a0b59f-79a5-480d-9a3f-0228e67133c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a0b59f-79a5-480d-9a3f-0228e67133c5', 'volume_size': 1} Jun 04 21:13:58.752448 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] creating volume 'volume-d9a0b59f-79a5-480d-9a3f-0228e67133c5' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:13:58.756829 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:13:58.896042 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:13:58.896634 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:13:58.903972 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c668a764-a5d6-4a5b-9e49-905bf34ea033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a0b59f-79a5-480d-9a3f-0228e67133c5', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:58.911555 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f74381b-c7c6-4882-bc03-815ffd71dea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:13:58.922977 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Volume volume-d9a0b59f-79a5-480d-9a3f-0228e67133c5 (d9a0b59f-79a5-480d-9a3f-0228e67133c5): created successfully Jun 04 21:13:58.929241 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f74381b-c7c6-4882-bc03-815ffd71dea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:13:58.935617 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (425d3efd-ceff-4762-ab96-87b93af9e1a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:13:58.947800 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-af5f47a9-fea9-4510-8014-94dbece68108 tempest-VolumesActionsTest-685284692 None] Created volume successfully. Jun 04 21:13:59.704176 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-bd6e641d-3c31-4566-ab6c-55a585d1b6a8 tempest-VolumesActionsTest-685284692 None] Lock "b'cinder-d9a0b59f-79a5-480d-9a3f-0228e67133c5'" acquired by "attach_volume" :: waited 0.013s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:13:59.767871 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-bd6e641d-3c31-4566-ab6c-55a585d1b6a8 tempest-VolumesActionsTest-685284692 None] Attaching volume d9a0b59f-79a5-480d-9a3f-0228e67133c5 to instance 23d8902f-000b-4a45-9cca-5b4a4a0535ca at mountpoint /dev/sdb on host None. Jun 04 21:13:59.845954 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-bd6e641d-3c31-4566-ab6c-55a585d1b6a8 tempest-VolumesActionsTest-685284692 None] Attach volume completed successfully. Jun 04 21:13:59.853889 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-bd6e641d-3c31-4566-ab6c-55a585d1b6a8 tempest-VolumesActionsTest-685284692 None] Lock "b'cinder-d9a0b59f-79a5-480d-9a3f-0228e67133c5'" released by "attach_volume" :: held 0.150s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:13:59.879771 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4183aaf4-5b8e-4dd6-8c93-9deccd381912 tempest-TestVolumeBackupRestore-633667600 None] Terminate volume connection completed successfully. Jun 04 21:13:59.905086 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4183aaf4-5b8e-4dd6-8c93-9deccd381912 tempest-TestVolumeBackupRestore-633667600 None] Remove volume export completed successfully. Jun 04 21:14:00.652127 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-fe66217c-2fdf-4f39-8ef5-fd9b0461b66b tempest-VolumesActionsTest-1472813104 None] Terminate volume connection completed successfully. Jun 04 21:14:00.699876 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-fe66217c-2fdf-4f39-8ef5-fd9b0461b66b tempest-VolumesActionsTest-1472813104 None] Lock "b'cinder-d9a0b59f-79a5-480d-9a3f-0228e67133c5-detach_volume'" acquired by "detach_volume" :: waited 0.016s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:00.723602 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-fe66217c-2fdf-4f39-8ef5-fd9b0461b66b tempest-VolumesActionsTest-1472813104 None] Detaching volume d9a0b59f-79a5-480d-9a3f-0228e67133c5 from instance 23d8902f-000b-4a45-9cca-5b4a4a0535ca. Jun 04 21:14:00.775232 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-fe66217c-2fdf-4f39-8ef5-fd9b0461b66b tempest-VolumesActionsTest-1472813104 None] Detach volume completed successfully. Jun 04 21:14:00.781755 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-fe66217c-2fdf-4f39-8ef5-fd9b0461b66b tempest-VolumesActionsTest-1472813104 None] Lock "b'cinder-d9a0b59f-79a5-480d-9a3f-0228e67133c5-detach_volume'" released by "detach_volume" :: held 0.082s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:01.116762 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-fd99e195-e3ff-4be6-b750-9dd1ab5c3b28 tempest-VolumesActionsTest-685284692 None] Lock "b'cinder-d9a0b59f-79a5-480d-9a3f-0228e67133c5-detach_volume'" acquired by "detach_volume" :: waited 0.016s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:01.118317 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-fd99e195-e3ff-4be6-b750-9dd1ab5c3b28 tempest-VolumesActionsTest-685284692 None] Volume detach called, but volume not attached. Jun 04 21:14:01.159785 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-fd99e195-e3ff-4be6-b750-9dd1ab5c3b28 tempest-VolumesActionsTest-685284692 None] Lock "b'cinder-d9a0b59f-79a5-480d-9a3f-0228e67133c5-detach_volume'" released by "detach_volume" :: held 0.043s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:01.545996 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:14:01.567063 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Flow 'volume_create_manager' (63ca8005-dbad-4de6-bfb4-6c9ac8701816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:01.573833 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b818201-1c1f-44f8-aa40-69b5b4d415fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:01.591730 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b818201-1c1f-44f8-aa40-69b5b4d415fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:14:01Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_a91f2a80-881b-42e6-9584-0e8a17178049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f35ce8e5-9954-4c05-b8de-30197fd428d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f7eafafd554647ad42646ebdc1aa1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:14:02Z,use_quota=True,user_id='2ed5143e191a43cc892a9428a2a8376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:01.597795 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e324d423-4606-4675-bc3f-d5d1a716cb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:01.602630 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e324d423-4606-4675-bc3f-d5d1a716cb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:01.607797 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0356d686-f340-47d2-a1e8-07edf7a3cde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:01.611851 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0356d686-f340-47d2-a1e8-07edf7a3cde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35ce8e5-9954-4c05-b8de-30197fd428d2', 'volume_name': 'volume-f35ce8e5-9954-4c05-b8de-30197fd428d2', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:01.616987 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6f0371-7b10-42e2-859e-c149e33c47fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:01.620765 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6f0371-7b10-42e2-859e-c149e33c47fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:01.625281 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05f3a65-2e24-40c2-aa26-2e119f791708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:01.626346 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Volume f35ce8e5-9954-4c05-b8de-30197fd428d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35ce8e5-9954-4c05-b8de-30197fd428d2', 'volume_size': 1} Jun 04 21:14:01.626741 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] creating volume 'volume-f35ce8e5-9954-4c05-b8de-30197fd428d2' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:14:01.627422 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:01.713323 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:14:01.713777 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:14:01.718296 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05f3a65-2e24-40c2-aa26-2e119f791708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35ce8e5-9954-4c05-b8de-30197fd428d2', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:01.729986 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cadaa54-9e6d-45d7-8806-bac0f5b6bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:01.742321 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Volume volume-f35ce8e5-9954-4c05-b8de-30197fd428d2 (f35ce8e5-9954-4c05-b8de-30197fd428d2): created successfully Jun 04 21:14:01.746144 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cadaa54-9e6d-45d7-8806-bac0f5b6bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:01.754405 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Flow 'volume_create_manager' (63ca8005-dbad-4de6-bfb4-6c9ac8701816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:01.766339 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Created volume successfully. Jun 04 21:14:02.626835 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:14:03.331385 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.704s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:14:03.332345 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f35ce8e5-9954-4c05-b8de-30197fd428d2', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'f35ce8e5-9954-4c05-b8de-30197fd428d2', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:14:03.351799 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Initialize volume connection completed successfully. Jun 04 21:14:04.970478 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=60,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:05.367921 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=43,cinder:UPDATE=10,cinder:INSERT=11,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:05.409318 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:14:05.435760 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (5708f0b5-873c-4008-9738-c43a6edc0b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:05.445319 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e66e939-f5af-4858-9f7c-afb2b03d31f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:05.468914 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e66e939-f5af-4858-9f7c-afb2b03d31f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-162237355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1e9ac39-2d1c-438d-ad76-752b46d9c99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f970c3882e940f98bab811c9fdd078a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:14:05Z,use_quota=True,user_id='4eccde33e4f44565b9e7ed25ba378948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:05.474949 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5353f213-435b-4f1e-b0c8-c03e4d224973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:05.479900 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5353f213-435b-4f1e-b0c8-c03e4d224973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:05.485586 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56aafc06-2d16-44ec-ab12-5d37b02bcf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:05.490023 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56aafc06-2d16-44ec-ab12-5d37b02bcf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e9ac39-2d1c-438d-ad76-752b46d9c99a', 'volume_name': 'volume-c1e9ac39-2d1c-438d-ad76-752b46d9c99a', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:05.494966 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bb8601-56bc-48cb-abdd-3577aa9bb649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:05.498925 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bb8601-56bc-48cb-abdd-3577aa9bb649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:05.504290 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8063c627-20b1-487c-9a59-30283f68d995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:05.505475 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Volume c1e9ac39-2d1c-438d-ad76-752b46d9c99a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e9ac39-2d1c-438d-ad76-752b46d9c99a', 'volume_size': 1} Jun 04 21:14:05.505949 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] creating volume 'volume-c1e9ac39-2d1c-438d-ad76-752b46d9c99a' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:14:05.506711 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:05.788285 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:14:05.788758 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:14:05.793040 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8063c627-20b1-487c-9a59-30283f68d995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e9ac39-2d1c-438d-ad76-752b46d9c99a', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:05.807298 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f734bba-86b0-4bb8-8585-23dd7bb3fab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:05.824292 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Volume volume-c1e9ac39-2d1c-438d-ad76-752b46d9c99a (c1e9ac39-2d1c-438d-ad76-752b46d9c99a): created successfully Jun 04 21:14:05.829782 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f734bba-86b0-4bb8-8585-23dd7bb3fab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:05.838601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (5708f0b5-873c-4008-9738-c43a6edc0b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:05.856481 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-7821e8af-508d-4ff9-8f29-1f758b350f81 tempest-VolumesActionsTest-685284692 None] Created volume successfully. Jun 04 21:14:06.980136 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-5db8f0d3-d678-4492-b42a-eb9c5d0694b1 tempest-VolumesActionsTest-1472813104 None] Lock "b'cinder-c1e9ac39-2d1c-438d-ad76-752b46d9c99a-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:07.042013 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5db8f0d3-d678-4492-b42a-eb9c5d0694b1 tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:07.180754 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5db8f0d3-d678-4492-b42a-eb9c5d0694b1 tempest-VolumesActionsTest-1472813104 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:07.181907 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5db8f0d3-d678-4492-b42a-eb9c5d0694b1 tempest-VolumesActionsTest-1472813104 None] Volume volume-c1e9ac39-2d1c-438d-ad76-752b46d9c99a is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:07.218899 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5db8f0d3-d678-4492-b42a-eb9c5d0694b1 tempest-VolumesActionsTest-1472813104 None] deleting rbd volume volume-c1e9ac39-2d1c-438d-ad76-752b46d9c99a {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:08.570051 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-5db8f0d3-d678-4492-b42a-eb9c5d0694b1 tempest-VolumesActionsTest-1472813104 None] Created reservations ['33dece75-8daa-4c89-bdd5-0123dd082ee9', '791a2445-b529-4b45-b726-3585878e2ca9', '77e854ab-cbe1-4b55-97ad-7e1f41f3e513', '3e01cb76-793a-409a-be5a-ae26ca060d92'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:08.745363 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5db8f0d3-d678-4492-b42a-eb9c5d0694b1 tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:08.843116 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5db8f0d3-d678-4492-b42a-eb9c5d0694b1 tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:08.946306 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-5db8f0d3-d678-4492-b42a-eb9c5d0694b1 tempest-VolumesActionsTest-1472813104 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:08.954311 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-5db8f0d3-d678-4492-b42a-eb9c5d0694b1 tempest-VolumesActionsTest-1472813104 None] Deleted volume successfully. Jun 04 21:14:08.985776 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-5db8f0d3-d678-4492-b42a-eb9c5d0694b1 tempest-VolumesActionsTest-1472813104 None] Lock "b'cinder-c1e9ac39-2d1c-438d-ad76-752b46d9c99a-delete_volume'" released by "delete_volume" :: held 2.012s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:09.716343 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:14:09.741995 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (e9f9c778-e821-4fb2-aa31-9df1cb8e9aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:09.749490 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f63e1ed-35da-403f-97e5-f6f4178e3105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:09.768980 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f63e1ed-35da-403f-97e5-f6f4178e3105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-493461665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f397f83-4588-4aef-bbc3-9495830fbd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f970c3882e940f98bab811c9fdd078a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:14:10Z,use_quota=True,user_id='4eccde33e4f44565b9e7ed25ba378948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:09.775059 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d8199a-0a96-4718-8c96-046fb9740ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:09.779247 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d8199a-0a96-4718-8c96-046fb9740ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:09.785673 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a248360-0b23-4e8d-a49c-69841bfd7427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:09.790154 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a248360-0b23-4e8d-a49c-69841bfd7427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f397f83-4588-4aef-bbc3-9495830fbd62', 'volume_name': 'volume-4f397f83-4588-4aef-bbc3-9495830fbd62', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:09.797030 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3ab970-2177-4419-81b3-c0cb1b1d6685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:09.802264 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3ab970-2177-4419-81b3-c0cb1b1d6685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:09.806995 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f19784-7ba4-4a5f-aaad-deb4637906f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:09.808106 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Volume 4f397f83-4588-4aef-bbc3-9495830fbd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f397f83-4588-4aef-bbc3-9495830fbd62', 'volume_size': 1} Jun 04 21:14:09.808677 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] creating volume 'volume-4f397f83-4588-4aef-bbc3-9495830fbd62' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:14:09.809457 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:09.941469 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:14:09.941923 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:14:09.947498 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f19784-7ba4-4a5f-aaad-deb4637906f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f397f83-4588-4aef-bbc3-9495830fbd62', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:09.952741 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef6da6a-9f2e-4a4c-9816-8f1bd25625cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:09.965211 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Volume volume-4f397f83-4588-4aef-bbc3-9495830fbd62 (4f397f83-4588-4aef-bbc3-9495830fbd62): created successfully Jun 04 21:14:09.970308 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef6da6a-9f2e-4a4c-9816-8f1bd25625cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:09.976789 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (e9f9c778-e821-4fb2-aa31-9df1cb8e9aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:09.987563 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0d73a841-04f3-4c54-a83d-a3c741da6c2a tempest-VolumesActionsTest-685284692 None] Created volume successfully. Jun 04 21:14:10.183837 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Terminate volume connection completed successfully. Jun 04 21:14:10.204120 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-be4c7a69-9261-4884-9fba-cfe5e0f29a8b tempest-TestVolumeBackupRestore-633667600 None] Remove volume export completed successfully. Jun 04 21:14:11.135100 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-dafda146-a632-440f-a788-05983bd6da76 tempest-VolumesActionsTest-1472813104 None] Lock "b'cinder-4f397f83-4588-4aef-bbc3-9495830fbd62-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:11.195001 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-dafda146-a632-440f-a788-05983bd6da76 tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:11.255472 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-dafda146-a632-440f-a788-05983bd6da76 tempest-VolumesActionsTest-1472813104 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:11.256479 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-dafda146-a632-440f-a788-05983bd6da76 tempest-VolumesActionsTest-1472813104 None] Volume volume-4f397f83-4588-4aef-bbc3-9495830fbd62 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:11.264034 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-dafda146-a632-440f-a788-05983bd6da76 tempest-VolumesActionsTest-1472813104 None] deleting rbd volume volume-4f397f83-4588-4aef-bbc3-9495830fbd62 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:11.678820 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-dafda146-a632-440f-a788-05983bd6da76 tempest-VolumesActionsTest-1472813104 None] Created reservations ['c73d7893-1d51-48be-bb10-b2a4f262d60b', '0b31bcd5-9c71-455b-b585-f4531f9f0664', '1de44f57-5fc6-468c-ae2b-1e00828a40d9', '0456989e-e503-4404-95ff-1a9113342b71'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:11.739645 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-dafda146-a632-440f-a788-05983bd6da76 tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:11.797003 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-dafda146-a632-440f-a788-05983bd6da76 tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:11.894955 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-dafda146-a632-440f-a788-05983bd6da76 tempest-VolumesActionsTest-1472813104 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:11.910061 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-dafda146-a632-440f-a788-05983bd6da76 tempest-VolumesActionsTest-1472813104 None] Deleted volume successfully. Jun 04 21:14:11.941106 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-dafda146-a632-440f-a788-05983bd6da76 tempest-VolumesActionsTest-1472813104 None] Lock "b'cinder-4f397f83-4588-4aef-bbc3-9495830fbd62-delete_volume'" released by "delete_volume" :: held 0.806s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:12.596279 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1b7c13f2-63ce-42c3-beba-3825a5cf40e9 tempest-GroupsV314Test-1174102235 None] Group tempest-GroupsV314Test-Group-1563976333: creating Jun 04 21:14:12.623350 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1b7c13f2-63ce-42c3-beba-3825a5cf40e9 tempest-GroupsV314Test-1174102235 None] Group tempest-GroupsV314Test-Group-1563976333: created successfully Jun 04 21:14:12.638604 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1b7c13f2-63ce-42c3-beba-3825a5cf40e9 tempest-GroupsV314Test-1174102235 None] Create group completed successfully. Jun 04 21:14:12.714945 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:14:12.738685 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (8112e842-843b-4821-80b6-1a2ddac06cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:12.744905 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84da1a09-8ab8-4248-9c50-27518327f6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:12.763419 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84da1a09-8ab8-4248-9c50-27518327f6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2043650588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d9af9a55-78ee-4246-8511-d6a6f67b2a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f970c3882e940f98bab811c9fdd078a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:14:13Z,use_quota=True,user_id='4eccde33e4f44565b9e7ed25ba378948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:12.769575 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96375436-de2e-4d5a-aa86-8c80bc3041aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:12.773978 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96375436-de2e-4d5a-aa86-8c80bc3041aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:12.779944 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f26a94-3219-4a87-9329-ac3b1c12708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:12.784821 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f26a94-3219-4a87-9329-ac3b1c12708d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9af9a55-78ee-4246-8511-d6a6f67b2a99', 'volume_name': 'volume-d9af9a55-78ee-4246-8511-d6a6f67b2a99', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:12.790369 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2524eafd-54d4-4bae-9b38-dffb52296a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:12.794352 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2524eafd-54d4-4bae-9b38-dffb52296a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:12.800162 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a60c493-1984-44f3-95d3-3b7c864ee380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:12.801464 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Volume d9af9a55-78ee-4246-8511-d6a6f67b2a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9af9a55-78ee-4246-8511-d6a6f67b2a99', 'volume_size': 1} Jun 04 21:14:12.802031 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] creating volume 'volume-d9af9a55-78ee-4246-8511-d6a6f67b2a99' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:14:12.802949 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:12.896647 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:14:12.897439 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:14:12.903601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a60c493-1984-44f3-95d3-3b7c864ee380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9af9a55-78ee-4246-8511-d6a6f67b2a99', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:12.911064 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e8e13c-961b-4f57-a382-aa174c504092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:12.925718 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Volume volume-d9af9a55-78ee-4246-8511-d6a6f67b2a99 (d9af9a55-78ee-4246-8511-d6a6f67b2a99): created successfully Jun 04 21:14:12.929522 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e8e13c-961b-4f57-a382-aa174c504092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:12.935297 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (8112e842-843b-4821-80b6-1a2ddac06cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:12.945676 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9610a99c-487f-43ab-a3f6-8f12c35d2435 tempest-VolumesActionsTest-685284692 None] Created volume successfully. Jun 04 21:14:13.989027 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-8802eb15-f76c-4edc-8b62-8a96d7bf8815 tempest-VolumesActionsTest-1472813104 None] Lock "b'cinder-d9af9a55-78ee-4246-8511-d6a6f67b2a99-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:14.053373 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8802eb15-f76c-4edc-8b62-8a96d7bf8815 tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:14.136157 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8802eb15-f76c-4edc-8b62-8a96d7bf8815 tempest-VolumesActionsTest-1472813104 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:14.136585 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8802eb15-f76c-4edc-8b62-8a96d7bf8815 tempest-VolumesActionsTest-1472813104 None] Volume volume-d9af9a55-78ee-4246-8511-d6a6f67b2a99 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:14.150566 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8802eb15-f76c-4edc-8b62-8a96d7bf8815 tempest-VolumesActionsTest-1472813104 None] deleting rbd volume volume-d9af9a55-78ee-4246-8511-d6a6f67b2a99 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:14.178341 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:14:14.216763 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Flow 'volume_create_manager' (808d47b4-c1c6-4056-abbd-b200d3721a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:14.235181 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e887c2-a55b-4d9b-9e32-c9c67f51aeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:14.262712 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e887c2-a55b-4d9b-9e32-c9c67f51aeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-791602567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=304412fd-9e7b-4149-a2b0-79c969d3074b,host='ncdv-master-1@ceph#ceph',id=e51b0405-752c-4c29-a548-fc4af56fc5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ece27e748544b38433cf664aca212b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:14:14Z,use_quota=True,user_id='19a821cb38e94517a154ef61fe994f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d11d46e-91d9-4764-949b-eb61cd2df2e0),volume_type_id=6d11d46e-91d9-4764-949b-eb61cd2df2e0)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:14.271152 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710c938c-d7f4-4452-a910-25b9cd4d48c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:14.276197 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710c938c-d7f4-4452-a910-25b9cd4d48c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:14.281757 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88a3172-2794-4eb4-b155-ffcf8ce29d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:14.286670 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88a3172-2794-4eb4-b155-ffcf8ce29d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e51b0405-752c-4c29-a548-fc4af56fc5ef', 'volume_name': 'volume-e51b0405-752c-4c29-a548-fc4af56fc5ef', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:14.295273 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0195cdf6-99de-4e00-979a-7d46b13d54e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:14.300325 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0195cdf6-99de-4e00-979a-7d46b13d54e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:14.305690 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3ca1b5-d592-4eb4-bf46-75d67ae6c5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:14.306980 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Volume e51b0405-752c-4c29-a548-fc4af56fc5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e51b0405-752c-4c29-a548-fc4af56fc5ef', 'volume_size': 1} Jun 04 21:14:14.307445 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] creating volume 'volume-e51b0405-752c-4c29-a548-fc4af56fc5ef' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:14:14.308496 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:14.472834 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:14:14.473517 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:14:14.482320 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3ca1b5-d592-4eb4-bf46-75d67ae6c5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51b0405-752c-4c29-a548-fc4af56fc5ef', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:14.488452 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791102e7-766f-4dbb-b434-b72a08544c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:14.503289 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Volume volume-e51b0405-752c-4c29-a548-fc4af56fc5ef (e51b0405-752c-4c29-a548-fc4af56fc5ef): created successfully Jun 04 21:14:14.508763 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791102e7-766f-4dbb-b434-b72a08544c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:14.514274 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Flow 'volume_create_manager' (808d47b4-c1c6-4056-abbd-b200d3721a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:14.533734 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-70f5e22b-5a02-4ae1-8a13-8ecbefcb1f71 tempest-GroupsV314Test-1174102235 None] Created volume successfully. Jun 04 21:14:14.648161 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-8802eb15-f76c-4edc-8b62-8a96d7bf8815 tempest-VolumesActionsTest-1472813104 None] Created reservations ['f181515d-c8eb-4355-8946-10145e467f77', '77592c71-b1e3-43c2-adbe-b2b4aad70e67', '26d03e22-c1f7-408a-80aa-eeca29f42920', '1043ef35-89a1-4fff-94b1-e30aae8ad955'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:14.699085 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=58,cinder:UPDATE=33,cinder:DELETE=4,cinder:INSERT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:14.722149 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8802eb15-f76c-4edc-8b62-8a96d7bf8815 tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:14.787990 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8802eb15-f76c-4edc-8b62-8a96d7bf8815 tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:14.828616 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-8802eb15-f76c-4edc-8b62-8a96d7bf8815 tempest-VolumesActionsTest-1472813104 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:14.836222 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8802eb15-f76c-4edc-8b62-8a96d7bf8815 tempest-VolumesActionsTest-1472813104 None] Deleted volume successfully. Jun 04 21:14:14.860909 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-8802eb15-f76c-4edc-8b62-8a96d7bf8815 tempest-VolumesActionsTest-1472813104 None] Lock "b'cinder-d9af9a55-78ee-4246-8511-d6a6f67b2a99-delete_volume'" released by "delete_volume" :: held 0.871s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:15.638200 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:14:15.681274 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (c02d35fa-aa82-432a-94f8-8281e4684e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:15.702177 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e3d114-05ac-459e-8f21-b4cd574b1ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:15.748220 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e3d114-05ac-459e-8f21-b4cd574b1ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-151366988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=56a29f0c-9d0b-4c70-a81b-bd689e97b30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f970c3882e940f98bab811c9fdd078a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:14:16Z,use_quota=True,user_id='4eccde33e4f44565b9e7ed25ba378948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:15.760917 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf4f648-295d-43d0-9428-d2310ad7a001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:15.770725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf4f648-295d-43d0-9428-d2310ad7a001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:15.784886 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc82d172-3f08-4f7f-8434-4a5c0c39a937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:15.792039 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc82d172-3f08-4f7f-8434-4a5c0c39a937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a29f0c-9d0b-4c70-a81b-bd689e97b30e', 'volume_name': 'volume-56a29f0c-9d0b-4c70-a81b-bd689e97b30e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:15.808619 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feeebe8e-9eee-4dd1-a5a1-fbfcfa2d3e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:15.812587 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feeebe8e-9eee-4dd1-a5a1-fbfcfa2d3e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:15.826789 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8366ca91-5060-4ff1-b3d0-ee94fe9a08c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:15.828870 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Volume 56a29f0c-9d0b-4c70-a81b-bd689e97b30e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a29f0c-9d0b-4c70-a81b-bd689e97b30e', 'volume_size': 1} Jun 04 21:14:15.828870 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] creating volume 'volume-56a29f0c-9d0b-4c70-a81b-bd689e97b30e' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:14:15.829056 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:15.871337 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-d992532b-f7d0-4e1f-959c-3793acb6272c req-7aa3a96b-3630-48ec-b3eb-1f02b6dcdbc7 tempest-TestVolumeBackupRestore-633667600 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:14:15.938557 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:14:15.938939 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:14:15.944274 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8366ca91-5060-4ff1-b3d0-ee94fe9a08c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a29f0c-9d0b-4c70-a81b-bd689e97b30e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:15.963274 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f87034f-5921-4f37-8c6a-4222a04f9c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:16.054036 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Volume volume-56a29f0c-9d0b-4c70-a81b-bd689e97b30e (56a29f0c-9d0b-4c70-a81b-bd689e97b30e): created successfully Jun 04 21:14:16.057561 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f87034f-5921-4f37-8c6a-4222a04f9c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:16.064638 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (c02d35fa-aa82-432a-94f8-8281e4684e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:16.081318 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=58,cinder:UPDATE=32,cinder:INSERT=7,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:16.097358 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0b77bf0d-c13c-4db7-8e9b-d33e4e60d2d7 tempest-GroupsV314Test-1174102235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:16.189108 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0b77bf0d-c13c-4db7-8e9b-d33e4e60d2d7 tempest-GroupsV314Test-1174102235 None] creating snapshot='volume-a6717518-2afc-4380-af86-c2e3c22a918b.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:14:17.084675 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0b77bf0d-c13c-4db7-8e9b-d33e4e60d2d7 tempest-GroupsV314Test-1174102235 None] cloning 'volume-e51b0405-752c-4c29-a548-fc4af56fc5ef@volume-a6717518-2afc-4380-af86-c2e3c22a918b.clone_snap' to 'volume-a6717518-2afc-4380-af86-c2e3c22a918b' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:14:17.097327 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-d992532b-f7d0-4e1f-959c-3793acb6272c req-7aa3a96b-3630-48ec-b3eb-1f02b6dcdbc7 tempest-TestVolumeBackupRestore-633667600 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.225s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:14:17.101139 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-7452b1a5-6787-4640-a7e8-deda48627663 tempest-VolumesActionsTest-685284692 None] Created volume successfully. Jun 04 21:14:17.117829 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-d992532b-f7d0-4e1f-959c-3793acb6272c req-7aa3a96b-3630-48ec-b3eb-1f02b6dcdbc7 tempest-TestVolumeBackupRestore-633667600 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f35ce8e5-9954-4c05-b8de-30197fd428d2', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'f35ce8e5-9954-4c05-b8de-30197fd428d2', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:14:17.169162 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-4e48b8a4-0b40-40ae-b12c-76db92cda00a tempest-VolumesActionsTest-1472813104 None] Lock "b'cinder-56a29f0c-9d0b-4c70-a81b-bd689e97b30e-delete_volume'" acquired by "delete_volume" :: waited 0.078s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:17.203306 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-d992532b-f7d0-4e1f-959c-3793acb6272c req-7aa3a96b-3630-48ec-b3eb-1f02b6dcdbc7 tempest-TestVolumeBackupRestore-633667600 None] Connection info returned from driver {'name': 'volumes/volume-f35ce8e5-9954-4c05-b8de-30197fd428d2', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f35ce8e5-9954-4c05-b8de-30197fd428d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3e3ee4d1-f950-4260-b897-1e02ca934032'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:14:17.256104 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0b77bf0d-c13c-4db7-8e9b-d33e4e60d2d7 tempest-GroupsV314Test-1174102235 None] Volume volume-e51b0405-752c-4c29-a548-fc4af56fc5ef is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:17.267769 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0b77bf0d-c13c-4db7-8e9b-d33e4e60d2d7 tempest-GroupsV314Test-1174102235 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:14:17.268491 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0b77bf0d-c13c-4db7-8e9b-d33e4e60d2d7 tempest-GroupsV314Test-1174102235 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:14:17.315576 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0b77bf0d-c13c-4db7-8e9b-d33e4e60d2d7 tempest-GroupsV314Test-1174102235 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:14:17.364170 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e48b8a4-0b40-40ae-b12c-76db92cda00a tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:17.447918 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e48b8a4-0b40-40ae-b12c-76db92cda00a tempest-VolumesActionsTest-1472813104 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:17.448644 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e48b8a4-0b40-40ae-b12c-76db92cda00a tempest-VolumesActionsTest-1472813104 None] Volume volume-56a29f0c-9d0b-4c70-a81b-bd689e97b30e is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:17.466913 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e48b8a4-0b40-40ae-b12c-76db92cda00a tempest-VolumesActionsTest-1472813104 None] deleting rbd volume volume-56a29f0c-9d0b-4c70-a81b-bd689e97b30e {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:17.501395 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-d992532b-f7d0-4e1f-959c-3793acb6272c req-7aa3a96b-3630-48ec-b3eb-1f02b6dcdbc7 tempest-TestVolumeBackupRestore-633667600 None] attachment_update completed successfully. Jun 04 21:14:17.623782 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0b77bf0d-c13c-4db7-8e9b-d33e4e60d2d7 tempest-GroupsV314Test-1174102235 None] Create group from source-group-304412fd-9e7b-4149-a2b0-79c969d3074b completed successfully. Jun 04 21:14:17.994979 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-4e48b8a4-0b40-40ae-b12c-76db92cda00a tempest-VolumesActionsTest-1472813104 None] Created reservations ['328aa004-9d51-4ca0-bc73-7c68785fb419', '128b211c-1f99-4772-b4ac-4b77c625f5e2', '6f7f2f6c-2b19-4f68-bc8b-c5f7431e3278', '08dd939a-fd8c-4ea2-9468-bb769c9c7c18'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:18.101010 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e48b8a4-0b40-40ae-b12c-76db92cda00a tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:18.145771 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e48b8a4-0b40-40ae-b12c-76db92cda00a tempest-VolumesActionsTest-1472813104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:18.199555 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-4e48b8a4-0b40-40ae-b12c-76db92cda00a tempest-VolumesActionsTest-1472813104 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:18.216340 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4e48b8a4-0b40-40ae-b12c-76db92cda00a tempest-VolumesActionsTest-1472813104 None] Deleted volume successfully. Jun 04 21:14:18.243395 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-4e48b8a4-0b40-40ae-b12c-76db92cda00a tempest-VolumesActionsTest-1472813104 None] Lock "b'cinder-56a29f0c-9d0b-4c70-a81b-bd689e97b30e-delete_volume'" released by "delete_volume" :: held 1.074s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:18.792974 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:18.866951 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:18.880416 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] deleting rbd volume volume-a6717518-2afc-4380-af86-c2e3c22a918b {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:19.196791 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:14:19.221868 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] Volume volume-e51b0405-752c-4c29-a548-fc4af56fc5ef is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:19.224293 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] deleting parent snapshot volume-a6717518-2afc-4380-af86-c2e3c22a918b.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:14:20.249707 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:14:20.280284 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (ee45f8b8-66be-4797-9a74-abe18fc08ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:20.287169 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bb63c0-eabe-4671-a3b8-74991ac5cb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:20.309924 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bb63c0-eabe-4671-a3b8-74991ac5cb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2052607185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7e9ba268-36e0-4690-9ab7-18363ed9633a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f970c3882e940f98bab811c9fdd078a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:14:20Z,use_quota=True,user_id='4eccde33e4f44565b9e7ed25ba378948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:20.315605 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07424546-07bb-442a-b930-f4e86f19ba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:20.319479 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07424546-07bb-442a-b930-f4e86f19ba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:20.324338 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf7c705-6737-485f-b811-e77cf9ab7cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:20.328150 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf7c705-6737-485f-b811-e77cf9ab7cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e9ba268-36e0-4690-9ab7-18363ed9633a', 'volume_name': 'volume-7e9ba268-36e0-4690-9ab7-18363ed9633a', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:20.332840 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad29f81-7001-4f75-b9b0-09e91decd683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:20.336518 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad29f81-7001-4f75-b9b0-09e91decd683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:20.340956 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46928d5d-e6fe-4fcb-9b61-30e832ef6e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:20.342110 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Volume 7e9ba268-36e0-4690-9ab7-18363ed9633a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e9ba268-36e0-4690-9ab7-18363ed9633a', 'volume_size': 1} Jun 04 21:14:20.342536 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] creating volume 'volume-7e9ba268-36e0-4690-9ab7-18363ed9633a' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:14:20.343487 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:20.384946 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] Created reservations ['f2501943-fd56-4725-a8c2-3f02c86eb1e9'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:20.406667 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-255613870 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-255613870, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:14:20.407447 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-255613870 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-255613870, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:14:20.422948 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:14:20.423316 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:14:20.427129 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46928d5d-e6fe-4fcb-9b61-30e832ef6e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9ba268-36e0-4690-9ab7-18363ed9633a', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:20.431399 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3379548c-246c-4853-88fe-589dabca1a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:20.436601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] Created reservations ['08f4d239-f376-4cce-9378-9456560eecd1', 'f1ab8d9f-e000-45a8-8323-2fe1b9b03a98', 'a88bc512-80d4-414f-91d7-b6203f4bdb9c', '592d29c0-9152-464c-8a15-f2e4167da654'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:20.445790 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Volume volume-7e9ba268-36e0-4690-9ab7-18363ed9633a (7e9ba268-36e0-4690-9ab7-18363ed9633a): created successfully Jun 04 21:14:20.449201 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3379548c-246c-4853-88fe-589dabca1a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:20.454367 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Flow 'volume_create_manager' (ee45f8b8-66be-4797-9a74-abe18fc08ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:20.470418 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-685ccc62-c74e-4728-9243-b35af078bb20 tempest-VolumesActionsTest-685284692 None] Created volume successfully. Jun 04 21:14:20.542313 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:20.582870 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:20.613977 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:20.620543 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-985f71c0-7971-46b8-8324-88bf51b1e5a1 tempest-GroupsV314Test-1174102235 None] Delete group completed successfully. Jun 04 21:14:21.174401 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ec651787-b83f-49c1-9c94-5ab971ef923b tempest-VolumesActionsTest-685284692 None] Lock "b'cinder-7e9ba268-36e0-4690-9ab7-18363ed9633a-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:21.245267 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec651787-b83f-49c1-9c94-5ab971ef923b tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:21.302858 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec651787-b83f-49c1-9c94-5ab971ef923b tempest-VolumesActionsTest-685284692 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:21.304205 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec651787-b83f-49c1-9c94-5ab971ef923b tempest-VolumesActionsTest-685284692 None] Volume volume-7e9ba268-36e0-4690-9ab7-18363ed9633a is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:21.317199 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec651787-b83f-49c1-9c94-5ab971ef923b tempest-VolumesActionsTest-685284692 None] deleting rbd volume volume-7e9ba268-36e0-4690-9ab7-18363ed9633a {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:21.327494 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ad4b3374-4b87-4626-9297-c0dde16112d7 tempest-GroupsV314Test-1174102235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:21.398165 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ad4b3374-4b87-4626-9297-c0dde16112d7 tempest-GroupsV314Test-1174102235 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:21.398600 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ad4b3374-4b87-4626-9297-c0dde16112d7 tempest-GroupsV314Test-1174102235 None] Volume volume-e51b0405-752c-4c29-a548-fc4af56fc5ef is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:21.407754 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ad4b3374-4b87-4626-9297-c0dde16112d7 tempest-GroupsV314Test-1174102235 None] deleting rbd volume volume-e51b0405-752c-4c29-a548-fc4af56fc5ef {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:21.681495 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=71,cinder:UPDATE=22,cinder:DELETE=1,cinder:INSERT=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:21.724687 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-ec651787-b83f-49c1-9c94-5ab971ef923b tempest-VolumesActionsTest-685284692 None] Created reservations ['a16c86dc-0ec0-44ab-831a-94476c65242b', '9af6cadd-5ca2-453a-93ab-ff10727b38be', 'fa2e3d8c-2a59-41e7-861c-efcb183e03a6', 'b754da30-2837-463d-b772-25b1abe66790'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:21.762471 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=64,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:21.793769 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec651787-b83f-49c1-9c94-5ab971ef923b tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:21.817564 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ec651787-b83f-49c1-9c94-5ab971ef923b tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:21.843228 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-ec651787-b83f-49c1-9c94-5ab971ef923b tempest-VolumesActionsTest-685284692 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:21.847873 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-ad4b3374-4b87-4626-9297-c0dde16112d7 tempest-GroupsV314Test-1174102235 None] Created reservations ['50247ed8-3e15-489f-a8dd-3b09aa189feb'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:21.850011 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ec651787-b83f-49c1-9c94-5ab971ef923b tempest-VolumesActionsTest-685284692 None] Deleted volume successfully. Jun 04 21:14:21.869626 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ec651787-b83f-49c1-9c94-5ab971ef923b tempest-VolumesActionsTest-685284692 None] Lock "b'cinder-7e9ba268-36e0-4690-9ab7-18363ed9633a-delete_volume'" released by "delete_volume" :: held 0.696s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:21.895748 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-ad4b3374-4b87-4626-9297-c0dde16112d7 tempest-GroupsV314Test-1174102235 None] Created reservations ['b581aefb-fee0-4012-9f42-41777039b094', '18045e99-f478-4537-b7a6-0b796dd45c6e', '74f0e2b5-0f8a-4000-8381-f2ecef10361d', '2b43da49-5d42-4cc1-9201-c5c43d1e4dd3'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:22.007184 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ad4b3374-4b87-4626-9297-c0dde16112d7 tempest-GroupsV314Test-1174102235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:22.039242 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ad4b3374-4b87-4626-9297-c0dde16112d7 tempest-GroupsV314Test-1174102235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:22.064281 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-ad4b3374-4b87-4626-9297-c0dde16112d7 tempest-GroupsV314Test-1174102235 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:22.069394 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ad4b3374-4b87-4626-9297-c0dde16112d7 tempest-GroupsV314Test-1174102235 None] Delete group completed successfully. Jun 04 21:14:22.425322 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-5cd76346-76a2-45ff-958e-e8c9439ab532 tempest-VolumesActionsTest-685284692 None] Lock "b'cinder-d9a0b59f-79a5-480d-9a3f-0228e67133c5-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:22.490851 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5cd76346-76a2-45ff-958e-e8c9439ab532 tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:22.581773 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5cd76346-76a2-45ff-958e-e8c9439ab532 tempest-VolumesActionsTest-685284692 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:22.582567 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5cd76346-76a2-45ff-958e-e8c9439ab532 tempest-VolumesActionsTest-685284692 None] Volume volume-d9a0b59f-79a5-480d-9a3f-0228e67133c5 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:22.595217 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5cd76346-76a2-45ff-958e-e8c9439ab532 tempest-VolumesActionsTest-685284692 None] deleting rbd volume volume-d9a0b59f-79a5-480d-9a3f-0228e67133c5 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:23.020001 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-5cd76346-76a2-45ff-958e-e8c9439ab532 tempest-VolumesActionsTest-685284692 None] Created reservations ['73fd9db7-3abe-46e0-83d2-1bad3e4d4c12', '1f98ddea-0494-462a-8602-b67fb19f5170', 'c6377f7f-521e-4f0e-90f8-bd652833950c', 'c6fea241-6842-4969-a3d3-f12ca344aea3'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:23.086537 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5cd76346-76a2-45ff-958e-e8c9439ab532 tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:23.147740 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5cd76346-76a2-45ff-958e-e8c9439ab532 tempest-VolumesActionsTest-685284692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:23.199458 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-5cd76346-76a2-45ff-958e-e8c9439ab532 tempest-VolumesActionsTest-685284692 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:23.204022 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-5cd76346-76a2-45ff-958e-e8c9439ab532 tempest-VolumesActionsTest-685284692 None] Deleted volume successfully. Jun 04 21:14:23.221371 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-5cd76346-76a2-45ff-958e-e8c9439ab532 tempest-VolumesActionsTest-685284692 None] Lock "b'cinder-d9a0b59f-79a5-480d-9a3f-0228e67133c5-delete_volume'" released by "delete_volume" :: held 0.796s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:30.585310 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:14:30.615728 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Flow 'volume_create_manager' (c58a2fb9-26b9-49fb-99ef-9542e7c5c6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:30.622378 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7692acbb-4d49-410e-b970-fbd2367d3899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:30.647906 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7692acbb-4d49-410e-b970-fbd2367d3899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-404732471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c70c7c27-609c-4e83-a0c8-8ae64f5d3850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5b4422e97e438596c8bc7267044fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:14:31Z,use_quota=True,user_id='2aeb7a48fd324a90a2eb1ecdd5ea8884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:30.655490 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d5ebec-9e13-4e71-b733-e826c32c4003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:30.662343 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d5ebec-9e13-4e71-b733-e826c32c4003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:30.668548 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a3b2b6-6c1e-4909-8008-884ae00a1120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:30.676166 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a3b2b6-6c1e-4909-8008-884ae00a1120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70c7c27-609c-4e83-a0c8-8ae64f5d3850', 'volume_name': 'volume-c70c7c27-609c-4e83-a0c8-8ae64f5d3850', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:30.683922 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82cd727c-44fe-493f-a980-95329800dac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:30.691098 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82cd727c-44fe-493f-a980-95329800dac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:30.700440 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d0f60c-17bc-4e19-8577-b63eb54112de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:30.701872 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Volume c70c7c27-609c-4e83-a0c8-8ae64f5d3850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70c7c27-609c-4e83-a0c8-8ae64f5d3850', 'volume_size': 1} Jun 04 21:14:30.702537 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] creating volume 'volume-c70c7c27-609c-4e83-a0c8-8ae64f5d3850' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:14:30.703775 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:30.804738 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:14:30.805956 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:14:30.813094 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d0f60c-17bc-4e19-8577-b63eb54112de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70c7c27-609c-4e83-a0c8-8ae64f5d3850', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:30.826437 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0979434-0c66-4163-a27e-00207267ad18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:30.839904 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Volume volume-c70c7c27-609c-4e83-a0c8-8ae64f5d3850 (c70c7c27-609c-4e83-a0c8-8ae64f5d3850): created successfully Jun 04 21:14:30.844010 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0979434-0c66-4163-a27e-00207267ad18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:30.854239 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Flow 'volume_create_manager' (c58a2fb9-26b9-49fb-99ef-9542e7c5c6a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:30.882542 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e2b8790a-65ec-4dee-9d62-6569112e8720 tempest-VolumesTransfersTest-1649541854 None] Created volume successfully. Jun 04 21:14:33.194579 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-711247c4-aec4-4829-b9d7-6f743645066a tempest-VolumesTransfersTest-1397561753 None] Transfer volume completed successfully. Jun 04 21:14:34.241264 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-32f3c30f-c03f-4f39-a987-c6f44df8d14c tempest-VolumesTransfersTest-1003808295 None] Lock "b'cinder-c70c7c27-609c-4e83-a0c8-8ae64f5d3850-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:34.296243 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f3c30f-c03f-4f39-a987-c6f44df8d14c tempest-VolumesTransfersTest-1003808295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:34.392463 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f3c30f-c03f-4f39-a987-c6f44df8d14c tempest-VolumesTransfersTest-1003808295 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:34.393015 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f3c30f-c03f-4f39-a987-c6f44df8d14c tempest-VolumesTransfersTest-1003808295 None] Volume volume-c70c7c27-609c-4e83-a0c8-8ae64f5d3850 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:34.409056 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f3c30f-c03f-4f39-a987-c6f44df8d14c tempest-VolumesTransfersTest-1003808295 None] deleting rbd volume volume-c70c7c27-609c-4e83-a0c8-8ae64f5d3850 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:34.920336 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-32f3c30f-c03f-4f39-a987-c6f44df8d14c tempest-VolumesTransfersTest-1003808295 None] Created reservations ['2e497bf3-b005-405a-8052-90e9b0b899f9', 'fd5bea78-1ea8-428f-af3d-fda745ec8200', 'cf513ff0-23d3-4fb2-a481-1f00d3fb3bef', 'e8c40819-e33f-46a8-8366-158b5e0f7442'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:34.972550 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:INSERT=11,cinder:SELECT=51,cinder:UPDATE=37,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:35.021052 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f3c30f-c03f-4f39-a987-c6f44df8d14c tempest-VolumesTransfersTest-1003808295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:35.100615 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f3c30f-c03f-4f39-a987-c6f44df8d14c tempest-VolumesTransfersTest-1003808295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:35.146222 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-32f3c30f-c03f-4f39-a987-c6f44df8d14c tempest-VolumesTransfersTest-1003808295 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:35.152230 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-32f3c30f-c03f-4f39-a987-c6f44df8d14c tempest-VolumesTransfersTest-1003808295 None] Deleted volume successfully. Jun 04 21:14:35.169129 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-32f3c30f-c03f-4f39-a987-c6f44df8d14c tempest-VolumesTransfersTest-1003808295 None] Lock "b'cinder-c70c7c27-609c-4e83-a0c8-8ae64f5d3850-delete_volume'" released by "delete_volume" :: held 0.928s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:35.833628 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:14:35.858109 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Flow 'volume_create_manager' (0d5217f3-1515-46b6-880c-f293cad787f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:35.869857 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe748e7-0ceb-4482-a6d9-deefe3063e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:35.890805 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe748e7-0ceb-4482-a6d9-deefe3063e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2067564799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1036517c-3b73-419a-a5cf-6eb2df55f9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5b4422e97e438596c8bc7267044fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:14:36Z,use_quota=True,user_id='2aeb7a48fd324a90a2eb1ecdd5ea8884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:35.897183 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743eed93-ae62-47fb-9e69-602ad637854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:35.902163 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743eed93-ae62-47fb-9e69-602ad637854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:35.908115 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4e769d-4e07-404b-a4de-e5ff59026dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:35.912847 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4e769d-4e07-404b-a4de-e5ff59026dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1036517c-3b73-419a-a5cf-6eb2df55f9de', 'volume_name': 'volume-1036517c-3b73-419a-a5cf-6eb2df55f9de', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:35.917567 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a6bf2e-7541-499f-ad03-e93699ea37d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:35.921651 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a6bf2e-7541-499f-ad03-e93699ea37d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:35.926990 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55fdc1c-cf86-474f-81e7-b2e97c508dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:35.928209 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Volume 1036517c-3b73-419a-a5cf-6eb2df55f9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1036517c-3b73-419a-a5cf-6eb2df55f9de', 'volume_size': 1} Jun 04 21:14:35.928598 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] creating volume 'volume-1036517c-3b73-419a-a5cf-6eb2df55f9de' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:14:35.929357 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:36.085839 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:14:36.087063 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:14:36.091889 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55fdc1c-cf86-474f-81e7-b2e97c508dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1036517c-3b73-419a-a5cf-6eb2df55f9de', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:36.097906 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c0dd04-07cd-44d0-bd53-d3b705514f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:36.111599 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Volume volume-1036517c-3b73-419a-a5cf-6eb2df55f9de (1036517c-3b73-419a-a5cf-6eb2df55f9de): created successfully Jun 04 21:14:36.115885 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c0dd04-07cd-44d0-bd53-d3b705514f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:36.122069 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Flow 'volume_create_manager' (0d5217f3-1515-46b6-880c-f293cad787f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:36.136741 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-905b1596-09e6-4362-a1b8-1244fd54de78 tempest-VolumesTransfersTest-1649541854 None] Created volume successfully. Jun 04 21:14:37.320582 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-457bc277-a2e6-4758-909d-10d2aae35a0a tempest-VolumesTransfersTest-1003808295 None] Lock "b'cinder-1036517c-3b73-419a-a5cf-6eb2df55f9de-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:37.412115 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-457bc277-a2e6-4758-909d-10d2aae35a0a tempest-VolumesTransfersTest-1003808295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:37.521053 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-457bc277-a2e6-4758-909d-10d2aae35a0a tempest-VolumesTransfersTest-1003808295 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:37.521742 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-457bc277-a2e6-4758-909d-10d2aae35a0a tempest-VolumesTransfersTest-1003808295 None] Volume volume-1036517c-3b73-419a-a5cf-6eb2df55f9de is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:37.542219 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-457bc277-a2e6-4758-909d-10d2aae35a0a tempest-VolumesTransfersTest-1003808295 None] deleting rbd volume volume-1036517c-3b73-419a-a5cf-6eb2df55f9de {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:37.982818 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-457bc277-a2e6-4758-909d-10d2aae35a0a tempest-VolumesTransfersTest-1003808295 None] Created reservations ['db24c03b-7e63-486a-ae99-2171908ab236', 'bacf9ae3-b6ed-44ae-be7b-ae0b9e00cd86', '45196ea9-8404-4ff2-a4b7-1c5e7b48a375', '93de68a7-59b4-4e23-9c47-4c34a3e0f21c'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:37.999648 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=55,cinder:DELETE=2,cinder:INSERT=7,cinder:UPDATE=36 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:38.067945 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-457bc277-a2e6-4758-909d-10d2aae35a0a tempest-VolumesTransfersTest-1003808295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:38.145765 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-457bc277-a2e6-4758-909d-10d2aae35a0a tempest-VolumesTransfersTest-1003808295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:38.219045 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-457bc277-a2e6-4758-909d-10d2aae35a0a tempest-VolumesTransfersTest-1003808295 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:38.221338 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-457bc277-a2e6-4758-909d-10d2aae35a0a tempest-VolumesTransfersTest-1003808295 None] Deleted volume successfully. Jun 04 21:14:38.248311 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-457bc277-a2e6-4758-909d-10d2aae35a0a tempest-VolumesTransfersTest-1003808295 None] Lock "b'cinder-1036517c-3b73-419a-a5cf-6eb2df55f9de-delete_volume'" released by "delete_volume" :: held 0.930s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:44.519564 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-9da643d8-a4a5-4edb-901e-868145d961ca req-bb02f2b0-8cf5-4ad3-8c81-96f04e13ce8c tempest-TaggedBootDevicesTest_v242-575962399 None] Terminate volume connection completed successfully. Jun 04 21:14:44.520641 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-9da643d8-a4a5-4edb-901e-868145d961ca req-bb02f2b0-8cf5-4ad3-8c81-96f04e13ce8c tempest-TaggedBootDevicesTest_v242-575962399 None] Deleting attachment 272a056c-b6bd-4b8e-b46c-b296eff38490. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:14:44.708618 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-9da643d8-a4a5-4edb-901e-868145d961ca req-a03e5e1c-7374-4996-b39a-c60b04659d0d tempest-TaggedBootDevicesTest_v242-575962399 None] Terminate volume connection completed successfully. Jun 04 21:14:44.711012 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-9da643d8-a4a5-4edb-901e-868145d961ca req-a03e5e1c-7374-4996-b39a-c60b04659d0d tempest-TaggedBootDevicesTest_v242-575962399 None] Deleting attachment 71e7fe43-23f0-47bc-9f61-c795194f985b. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:14:44.929714 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-9da643d8-a4a5-4edb-901e-868145d961ca req-06a3e2bf-33e7-4962-aaf8-fca64f94b35b tempest-TaggedBootDevicesTest_v242-575962399 None] Terminate volume connection completed successfully. Jun 04 21:14:44.930633 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-9da643d8-a4a5-4edb-901e-868145d961ca req-06a3e2bf-33e7-4962-aaf8-fca64f94b35b tempest-TaggedBootDevicesTest_v242-575962399 None] Deleting attachment 12270265-1ad1-4f55-8d62-724f2c2823cd. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:14:45.349198 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:14:45.349861 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:45.445366 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:45.494872 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:48.921814 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:14:48.988348 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Flow 'volume_create_manager' (488ba731-5288-42d3-ae6c-283547024e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:48.999403 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1256ef91-a7b0-4357-be2f-205c24d31f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:49.022165 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1256ef91-a7b0-4357-be2f-205c24d31f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1970840242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c83cb92f-1797-4ef4-9bd9-24c7f5081d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a8c28e867e4f068eda630b49aa76f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:14:49Z,use_quota=True,user_id='e3dd0290b6e94050919656b761898ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:49.029541 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ba5af2-92a6-4518-b5fc-76db2eb6382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:49.034994 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ba5af2-92a6-4518-b5fc-76db2eb6382f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:49.040760 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7583b992-af7e-49d9-a007-4c630fecdfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:49.046064 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7583b992-af7e-49d9-a007-4c630fecdfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83cb92f-1797-4ef4-9bd9-24c7f5081d67', 'volume_name': 'volume-c83cb92f-1797-4ef4-9bd9-24c7f5081d67', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:49.052384 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ddb468-25d1-4260-9876-85f424f461ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:49.057171 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ddb468-25d1-4260-9876-85f424f461ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:49.062176 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfb3e5f-0301-4f0c-893b-044add1c5ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:49.063481 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Volume c83cb92f-1797-4ef4-9bd9-24c7f5081d67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83cb92f-1797-4ef4-9bd9-24c7f5081d67', 'volume_size': 1} Jun 04 21:14:49.064622 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] creating volume 'volume-c83cb92f-1797-4ef4-9bd9-24c7f5081d67' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:14:49.065470 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:49.224015 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:14:49.224567 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:14:49.228673 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfb3e5f-0301-4f0c-893b-044add1c5ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83cb92f-1797-4ef4-9bd9-24c7f5081d67', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:49.236833 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9cc847-c4e1-448b-9f01-5035b9bcddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:14:49.250248 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Volume volume-c83cb92f-1797-4ef4-9bd9-24c7f5081d67 (c83cb92f-1797-4ef4-9bd9-24c7f5081d67): created successfully Jun 04 21:14:49.255462 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9cc847-c4e1-448b-9f01-5035b9bcddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:14:49.263693 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Flow 'volume_create_manager' (488ba731-5288-42d3-ae6c-283547024e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:14:49.282001 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-21201419-6927-4d6d-9a48-7a81c6efddf6 tempest-VolumesActionsTest-459687928 None] Created volume successfully. Jun 04 21:14:54.523766 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-479936c2-f2bd-4511-984c-26575e9d391b tempest-TaggedBootDevicesTest_v242-575962399 None] Lock "b'cinder-d16e3dd4-cd03-43cd-b2b9-c804951744fa-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:54.594910 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-479936c2-f2bd-4511-984c-26575e9d391b tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:54.743039 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-479936c2-f2bd-4511-984c-26575e9d391b tempest-TaggedBootDevicesTest_v242-575962399 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:54.743461 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-479936c2-f2bd-4511-984c-26575e9d391b tempest-TaggedBootDevicesTest_v242-575962399 None] Volume volume-d16e3dd4-cd03-43cd-b2b9-c804951744fa is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:54.776475 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-479936c2-f2bd-4511-984c-26575e9d391b tempest-TaggedBootDevicesTest_v242-575962399 None] deleting rbd volume volume-d16e3dd4-cd03-43cd-b2b9-c804951744fa {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:55.487020 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-479936c2-f2bd-4511-984c-26575e9d391b tempest-TaggedBootDevicesTest_v242-575962399 None] Created reservations ['4369464c-a72b-489e-884b-b07e26bc0c0b', '5d889299-b150-4924-919c-fb469d7013c9', '584b3bd7-9ad0-4fe9-a53c-f92f5f495640', '47365322-357a-426b-b29f-f1436558a914'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:55.568781 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-479936c2-f2bd-4511-984c-26575e9d391b tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:55.639320 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-479936c2-f2bd-4511-984c-26575e9d391b tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:55.721082 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-479936c2-f2bd-4511-984c-26575e9d391b tempest-TaggedBootDevicesTest_v242-575962399 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:55.732290 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-479936c2-f2bd-4511-984c-26575e9d391b tempest-TaggedBootDevicesTest_v242-575962399 None] Deleted volume successfully. Jun 04 21:14:55.758551 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-479936c2-f2bd-4511-984c-26575e9d391b tempest-TaggedBootDevicesTest_v242-575962399 None] Lock "b'cinder-d16e3dd4-cd03-43cd-b2b9-c804951744fa-delete_volume'" released by "delete_volume" :: held 1.235s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:55.885345 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-9e8d9851-1046-4058-bbdb-caa6067d07fe tempest-TaggedBootDevicesTest_v242-575962399 None] Lock "b'cinder-66176986-39c7-4e62-9130-71c9355b1a92-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:55.991829 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9e8d9851-1046-4058-bbdb-caa6067d07fe tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:56.092342 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9e8d9851-1046-4058-bbdb-caa6067d07fe tempest-TaggedBootDevicesTest_v242-575962399 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:56.093221 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9e8d9851-1046-4058-bbdb-caa6067d07fe tempest-TaggedBootDevicesTest_v242-575962399 None] Volume volume-66176986-39c7-4e62-9130-71c9355b1a92 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:14:56.105432 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9e8d9851-1046-4058-bbdb-caa6067d07fe tempest-TaggedBootDevicesTest_v242-575962399 None] deleting rbd volume volume-66176986-39c7-4e62-9130-71c9355b1a92 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:56.814727 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-9e8d9851-1046-4058-bbdb-caa6067d07fe tempest-TaggedBootDevicesTest_v242-575962399 None] Created reservations ['1d2d6277-32b3-432c-8f64-9dc5334d7371', '0c8dc2b4-e141-4a13-9c45-b08b7bdc684c', '33b44760-aa1a-4161-a58f-516e2cbe5e32', '9161185b-ace3-4a47-94c6-716fadfb9e39'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:56.901614 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9e8d9851-1046-4058-bbdb-caa6067d07fe tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:56.954503 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9e8d9851-1046-4058-bbdb-caa6067d07fe tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:56.992330 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-9e8d9851-1046-4058-bbdb-caa6067d07fe tempest-TaggedBootDevicesTest_v242-575962399 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:56.998359 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9e8d9851-1046-4058-bbdb-caa6067d07fe tempest-TaggedBootDevicesTest_v242-575962399 None] Deleted volume successfully. Jun 04 21:14:57.016488 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-9e8d9851-1046-4058-bbdb-caa6067d07fe tempest-TaggedBootDevicesTest_v242-575962399 None] Lock "b'cinder-66176986-39c7-4e62-9130-71c9355b1a92-delete_volume'" released by "delete_volume" :: held 1.131s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:14:57.153347 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] Lock "b'cinder-0759769d-5fc7-469e-af57-4709d45e102f-delete_volume'" acquired by "delete_volume" :: waited 0.047s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:14:57.269731 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:57.421740 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:14:57.442544 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] deleting rbd volume volume-0759769d-5fc7-469e-af57-4709d45e102f {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:14:58.395486 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:14:58.441605 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] deleting parent snapshot volume-0759769d-5fc7-469e-af57-4709d45e102f.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:14:58.801019 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:DELETE=5,cinder:UPDATE=29,cinder:SELECT=61,cinder:INSERT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:58.826350 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] Created reservations ['1ea77389-1c04-454d-8de7-682787851415', '6befac64-6bb3-46cf-a1e4-396c2cc1ba49', '4eff9c29-14bb-43ee-9b82-3f13cdccf5a1', '54e106d5-c252-4ab5-97f1-e4e81d55e0f6'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:14:58.920362 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:59.012319 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:14:59.042574 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:14:59.056682 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] Deleted volume successfully. Jun 04 21:14:59.071584 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-55ad3237-d7a0-4f62-afb6-76983daeed4f tempest-TaggedBootDevicesTest_v242-575962399 None] Lock "b'cinder-0759769d-5fc7-469e-af57-4709d45e102f-delete_volume'" released by "delete_volume" :: held 1.918s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:15:09.061340 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=35,cinder:SELECT=53,cinder:INSERT=8,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:13.432882 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2a4a372b-5d13-4502-a649-16f94da757e6 tempest-VolumesActionsTest-459687928 None] Lock "b'cinder-c83cb92f-1797-4ef4-9bd9-24c7f5081d67'" acquired by "attach_volume" :: waited 0.012s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:15:13.490023 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2a4a372b-5d13-4502-a649-16f94da757e6 tempest-VolumesActionsTest-459687928 None] Attaching volume c83cb92f-1797-4ef4-9bd9-24c7f5081d67 to instance bc1f6287-1945-4ac2-889e-a7ee705a91fa at mountpoint /dev/sdb on host None. Jun 04 21:15:13.533417 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2a4a372b-5d13-4502-a649-16f94da757e6 tempest-VolumesActionsTest-459687928 None] Attach volume completed successfully. Jun 04 21:15:13.540800 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2a4a372b-5d13-4502-a649-16f94da757e6 tempest-VolumesActionsTest-459687928 None] Lock "b'cinder-c83cb92f-1797-4ef4-9bd9-24c7f5081d67'" released by "attach_volume" :: held 0.108s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:15:13.738104 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c9a5cf32-d90c-45fd-b50c-c09df9e5627c tempest-VolumesActionsTest-459687928 None] Lock "b'cinder-c83cb92f-1797-4ef4-9bd9-24c7f5081d67-detach_volume'" acquired by "detach_volume" :: waited 0.012s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:15:13.738572 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c9a5cf32-d90c-45fd-b50c-c09df9e5627c tempest-VolumesActionsTest-459687928 None] Detaching volume c83cb92f-1797-4ef4-9bd9-24c7f5081d67 from instance bc1f6287-1945-4ac2-889e-a7ee705a91fa. Jun 04 21:15:13.833590 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c9a5cf32-d90c-45fd-b50c-c09df9e5627c tempest-VolumesActionsTest-459687928 None] Detach volume completed successfully. Jun 04 21:15:13.839878 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c9a5cf32-d90c-45fd-b50c-c09df9e5627c tempest-VolumesActionsTest-459687928 None] Lock "b'cinder-c83cb92f-1797-4ef4-9bd9-24c7f5081d67-detach_volume'" released by "detach_volume" :: held 0.102s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:15:23.832462 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:34.980399 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=23,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:35.682076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0b1b94b8-3bc6-4ac9-a8de-b9c1550abe2d tempest-VolumesActionsTest-459687928 None] Lock "b'cinder-c83cb92f-1797-4ef4-9bd9-24c7f5081d67'" acquired by "attach_volume" :: waited 0.014s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:15:35.778021 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0b1b94b8-3bc6-4ac9-a8de-b9c1550abe2d tempest-VolumesActionsTest-459687928 None] Attaching volume c83cb92f-1797-4ef4-9bd9-24c7f5081d67 to instance ccc62820-497a-449c-8d4e-ce45c68fe8b5 at mountpoint /dev/sdb on host None. Jun 04 21:15:35.815929 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0b1b94b8-3bc6-4ac9-a8de-b9c1550abe2d tempest-VolumesActionsTest-459687928 None] Attach volume completed successfully. Jun 04 21:15:35.820311 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0b1b94b8-3bc6-4ac9-a8de-b9c1550abe2d tempest-VolumesActionsTest-459687928 None] Lock "b'cinder-c83cb92f-1797-4ef4-9bd9-24c7f5081d67'" released by "attach_volume" :: held 0.138s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:15:36.290059 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-4e032e6d-b916-471c-92ab-d39b38e877bd tempest-VolumesActionsTest-459687928 None] Lock "b'cinder-c83cb92f-1797-4ef4-9bd9-24c7f5081d67-detach_volume'" acquired by "detach_volume" :: waited 0.014s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:15:36.291567 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4e032e6d-b916-471c-92ab-d39b38e877bd tempest-VolumesActionsTest-459687928 None] Detaching volume c83cb92f-1797-4ef4-9bd9-24c7f5081d67 from instance ccc62820-497a-449c-8d4e-ce45c68fe8b5. Jun 04 21:15:36.364275 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4e032e6d-b916-471c-92ab-d39b38e877bd tempest-VolumesActionsTest-459687928 None] Detach volume completed successfully. Jun 04 21:15:36.375811 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-4e032e6d-b916-471c-92ab-d39b38e877bd tempest-VolumesActionsTest-459687928 None] Lock "b'cinder-c83cb92f-1797-4ef4-9bd9-24c7f5081d67-detach_volume'" released by "detach_volume" :: held 0.086s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:15:41.258698 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-290cf11c-f1a5-46c6-a029-dc6b51a98a51 req-fc70413e-823f-4d97-8ded-4cbb2a0e0e0e tempest-TestVolumeBackupRestore-633667600 None] Terminate volume connection completed successfully. Jun 04 21:15:41.259953 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-290cf11c-f1a5-46c6-a029-dc6b51a98a51 req-fc70413e-823f-4d97-8ded-4cbb2a0e0e0e tempest-TestVolumeBackupRestore-633667600 None] Deleting attachment 3e3ee4d1-f950-4260-b897-1e02ca934032. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:15:43.820732 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-e88d32fd-fbed-4325-b8db-dbc198a6d02c tempest-TestVolumeBackupRestore-633667600 None] Lock "b'cinder-f35ce8e5-9954-4c05-b8de-30197fd428d2-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:15:43.890577 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e88d32fd-fbed-4325-b8db-dbc198a6d02c tempest-TestVolumeBackupRestore-633667600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:15:44.756211 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e88d32fd-fbed-4325-b8db-dbc198a6d02c tempest-TestVolumeBackupRestore-633667600 None] Volume volume-f35ce8e5-9954-4c05-b8de-30197fd428d2 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:15:44.808481 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e88d32fd-fbed-4325-b8db-dbc198a6d02c tempest-TestVolumeBackupRestore-633667600 None] deleting rbd volume volume-f35ce8e5-9954-4c05-b8de-30197fd428d2 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:15:44.863152 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-6008ba6b-7dc8-4b3c-ab59-f591d36ea06e tempest-VolumesActionsTest-459687928 None] Running cmd (subprocess): rbd export --pool volumes volume-c83cb92f-1797-4ef4-9bd9-24c7f5081d67 /opt/stack/data/cinder/conversion/volume-c83cb92f-1797-4ef4-9bd9-24c7f5081d67-8b13a1c9-3416-43aa-bfb6-2c0e46251cba --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:15:44.913818 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-1f6d2a78-a7aa-4ee7-975c-c010e5d5cad1 tempest-TestVolumeBackupRestore-633667600 None] Lock "b'cinder-5b2e23f7-37ef-436d-b587-020bdcf55af8-delete_volume'" acquired by "delete_volume" :: waited 0.089s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:15:45.016330 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1f6d2a78-a7aa-4ee7-975c-c010e5d5cad1 tempest-TestVolumeBackupRestore-633667600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:15:46.047087 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1f6d2a78-a7aa-4ee7-975c-c010e5d5cad1 tempest-TestVolumeBackupRestore-633667600 None] deleting rbd volume volume-5b2e23f7-37ef-436d-b587-020bdcf55af8 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:15:46.353899 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-6008ba6b-7dc8-4b3c-ab59-f591d36ea06e tempest-VolumesActionsTest-459687928 None] CMD "rbd export --pool volumes volume-c83cb92f-1797-4ef4-9bd9-24c7f5081d67 /opt/stack/data/cinder/conversion/volume-c83cb92f-1797-4ef4-9bd9-24c7f5081d67-8b13a1c9-3416-43aa-bfb6-2c0e46251cba --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.477s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:15:46.434026 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.image_utils [None req-6008ba6b-7dc8-4b3c-ab59-f591d36ea06e tempest-VolumesActionsTest-459687928 None] 8b13a1c9-3416-43aa-bfb6-2c0e46251cba was raw, no need to convert to raw {{(pid=130490) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:851}} Jun 04 21:15:46.599193 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-e88d32fd-fbed-4325-b8db-dbc198a6d02c tempest-TestVolumeBackupRestore-633667600 None] Created reservations ['6cef3086-58a1-439f-b3c3-ebc276c7aaa1', '6b401f92-fd79-4fab-a2d5-e0062a1fc15a', '431de1c3-963b-4df0-9230-a1575314232c', 'a202e35c-ae19-40d0-9da9-97da4fc1362e'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:15:46.710405 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1f6d2a78-a7aa-4ee7-975c-c010e5d5cad1 tempest-TestVolumeBackupRestore-633667600 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:15:46.767702 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1f6d2a78-a7aa-4ee7-975c-c010e5d5cad1 tempest-TestVolumeBackupRestore-633667600 None] deleting parent snapshot volume-5b2e23f7-37ef-436d-b587-020bdcf55af8.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:15:48.006118 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e88d32fd-fbed-4325-b8db-dbc198a6d02c tempest-TestVolumeBackupRestore-633667600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:15:48.090903 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e88d32fd-fbed-4325-b8db-dbc198a6d02c tempest-TestVolumeBackupRestore-633667600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:15:48.189062 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-e88d32fd-fbed-4325-b8db-dbc198a6d02c tempest-TestVolumeBackupRestore-633667600 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:15:48.201403 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e88d32fd-fbed-4325-b8db-dbc198a6d02c tempest-TestVolumeBackupRestore-633667600 None] Deleted volume successfully. Jun 04 21:15:48.246874 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-e88d32fd-fbed-4325-b8db-dbc198a6d02c tempest-TestVolumeBackupRestore-633667600 None] Lock "b'cinder-f35ce8e5-9954-4c05-b8de-30197fd428d2-delete_volume'" released by "delete_volume" :: held 4.424s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:15:48.252228 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-1f6d2a78-a7aa-4ee7-975c-c010e5d5cad1 tempest-TestVolumeBackupRestore-633667600 None] Created reservations ['af1a4fe0-b107-4b14-8415-2d4275f2cf4f', '40feb6f9-b02c-4e8f-b5bb-7e5e7a83d021', 'f71773b2-e734-4898-bcc6-904530bc9729', 'b6af9ce8-3f24-48f7-9fc6-ff8c7b87bb10'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:15:48.368764 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1f6d2a78-a7aa-4ee7-975c-c010e5d5cad1 tempest-TestVolumeBackupRestore-633667600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:15:48.428591 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1f6d2a78-a7aa-4ee7-975c-c010e5d5cad1 tempest-TestVolumeBackupRestore-633667600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:15:48.522988 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-1f6d2a78-a7aa-4ee7-975c-c010e5d5cad1 tempest-TestVolumeBackupRestore-633667600 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:15:48.527725 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1f6d2a78-a7aa-4ee7-975c-c010e5d5cad1 tempest-TestVolumeBackupRestore-633667600 None] Deleted volume successfully. Jun 04 21:15:48.554331 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-1f6d2a78-a7aa-4ee7-975c-c010e5d5cad1 tempest-TestVolumeBackupRestore-633667600 None] Lock "b'cinder-5b2e23f7-37ef-436d-b587-020bdcf55af8-delete_volume'" released by "delete_volume" :: held 3.641s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:15:58.533659 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=44,cinder:UPDATE=20,cinder:INSERT=2,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:14.982079 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:14.989172 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=45,cinder:INSERT=8,cinder:UPDATE=22 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:25.048669 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6008ba6b-7dc8-4b3c-ab59-f591d36ea06e tempest-VolumesActionsTest-459687928 None] Uploaded volume to glance image-id: 8b13a1c9-3416-43aa-bfb6-2c0e46251cba. {{(pid=130490) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1751}} Jun 04 21:16:25.054310 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:25.094581 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-6008ba6b-7dc8-4b3c-ab59-f591d36ea06e tempest-VolumesActionsTest-459687928 None] Copy volume to image completed successfully. Jun 04 21:16:26.568216 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-b6c38626-eb5a-4a22-96e0-da447bbc607a tempest-VolumesActionsTest-459687928 None] Lock "b'cinder-c83cb92f-1797-4ef4-9bd9-24c7f5081d67-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:16:26.627964 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b6c38626-eb5a-4a22-96e0-da447bbc607a tempest-VolumesActionsTest-459687928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:16:26.711457 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b6c38626-eb5a-4a22-96e0-da447bbc607a tempest-VolumesActionsTest-459687928 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:16:26.711920 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b6c38626-eb5a-4a22-96e0-da447bbc607a tempest-VolumesActionsTest-459687928 None] Volume volume-c83cb92f-1797-4ef4-9bd9-24c7f5081d67 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:16:26.722559 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b6c38626-eb5a-4a22-96e0-da447bbc607a tempest-VolumesActionsTest-459687928 None] deleting rbd volume volume-c83cb92f-1797-4ef4-9bd9-24c7f5081d67 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:16:27.251151 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-b6c38626-eb5a-4a22-96e0-da447bbc607a tempest-VolumesActionsTest-459687928 None] Created reservations ['bd6885f2-fbf3-459e-adb2-1fa8f77655ca', 'f21c15cd-4797-49f1-a91a-3d8bc8dbee66', '4ec3dd06-b737-4083-9cb6-0fb6bbe43cfb', 'f216b21a-10b5-48da-bad0-1ae343436716'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:16:27.334509 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b6c38626-eb5a-4a22-96e0-da447bbc607a tempest-VolumesActionsTest-459687928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:16:27.416196 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b6c38626-eb5a-4a22-96e0-da447bbc607a tempest-VolumesActionsTest-459687928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:16:27.487844 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-b6c38626-eb5a-4a22-96e0-da447bbc607a tempest-VolumesActionsTest-459687928 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:16:27.492123 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b6c38626-eb5a-4a22-96e0-da447bbc607a tempest-VolumesActionsTest-459687928 None] Deleted volume successfully. Jun 04 21:16:27.510429 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-b6c38626-eb5a-4a22-96e0-da447bbc607a tempest-VolumesActionsTest-459687928 None] Lock "b'cinder-c83cb92f-1797-4ef4-9bd9-24c7f5081d67-delete_volume'" released by "delete_volume" :: held 0.942s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:16:34.383623 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:16:34.417257 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (2a7574a3-9419-4c86-913d-2ac3ead99c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:16:34.436575 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833c40ac-78ad-438b-8826-732170741685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:34.470335 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833c40ac-78ad-438b-8826-732170741685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-577161677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1cc49d5c-997d-437a-81e2-dc8b803becae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e56305a8994e3ca45920448336ba18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:16:34Z,use_quota=True,user_id='59e619953f32406891051e0e029c1670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:34.476738 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15102ad-1b75-4c8e-84fd-144f21ed95bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:34.482482 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15102ad-1b75-4c8e-84fd-144f21ed95bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:34.491041 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580625f7-874a-4152-9382-55d8c7b10c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:34.497165 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580625f7-874a-4152-9382-55d8c7b10c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc49d5c-997d-437a-81e2-dc8b803becae', 'volume_name': 'volume-1cc49d5c-997d-437a-81e2-dc8b803becae', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:34.510558 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392d1fc3-abd0-4a85-b343-1173208a7cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:34.515419 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392d1fc3-abd0-4a85-b343-1173208a7cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:34.521692 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785e74ac-03f7-4cdd-aaf7-c81750877203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:34.523025 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Volume 1cc49d5c-997d-437a-81e2-dc8b803becae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc49d5c-997d-437a-81e2-dc8b803becae', 'volume_size': 1} Jun 04 21:16:34.523662 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] creating volume 'volume-1cc49d5c-997d-437a-81e2-dc8b803becae' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:16:34.525280 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:16:34.626442 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:16:34.626863 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:16:34.630982 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785e74ac-03f7-4cdd-aaf7-c81750877203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc49d5c-997d-437a-81e2-dc8b803becae', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:34.640634 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a95750-baba-4215-8b56-97d60f219d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:34.690929 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Volume volume-1cc49d5c-997d-437a-81e2-dc8b803becae (1cc49d5c-997d-437a-81e2-dc8b803becae): created successfully Jun 04 21:16:34.696992 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a95750-baba-4215-8b56-97d60f219d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:34.705032 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (2a7574a3-9419-4c86-913d-2ac3ead99c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:16:34.728751 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e55fec68-6e9f-456e-ad3d-d9e101abd01f tempest-VolumesSnapshotTestJSON-1648955989 None] Created volume successfully. Jun 04 21:16:35.787123 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-98285206-61da-479f-881e-17e69d9f6579 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:16:36.291362 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-98285206-61da-479f-881e-17e69d9f6579 tempest-VolumesSnapshotTestJSON-1648955989 None] Create snapshot completed successfully Jun 04 21:16:37.389724 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.driver [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] Creating a new backup for volume volume-1cc49d5c-997d-437a-81e2-dc8b803becae. {{(pid=130490) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1213}} Jun 04 21:16:37.468318 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] cloning volumes/volume-1cc49d5c-997d-437a-81e2-dc8b803becae@snapshot-381b580f-61c1-4781-b5c2-7fb78658db63 to volume-3d065472-61d6-4025-a119-ac331062b6cb {{(pid=130490) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} Jun 04 21:16:37.468318 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:16:37.533899 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:16:37.784283 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:16:37.784654 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:16:37.830297 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-04T21:16:36Z,data_timestamp=2022-06-04T21:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-624894311',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=c9a1afec-67e1-46bd-9c94-a43a9454f31f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='82e56305a8994e3ca45920448336ba18',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='381b580f-61c1-4781-b5c2-7fb78658db63',status='creating',temp_snapshot_id=None,temp_volume_id='3d065472-61d6-4025-a119-ac331062b6cb',updated_at=None,user_id='59e619953f32406891051e0e029c1670',volume_id=1cc49d5c-997d-437a-81e2-dc8b803becae) Jun 04 21:16:37.831261 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.backup.rpcapi [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] continue_backup in rpcapi backup_id c9a1afec-67e1-46bd-9c94-a43a9454f31f {{(pid=130490) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 04 21:16:38.198654 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:16:39.284921 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.086s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:16:39.285973 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3d065472-61d6-4025-a119-ac331062b6cb', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '3d065472-61d6-4025-a119-ac331062b6cb', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:16:39.314104 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] Initialize volume connection completed successfully. Jun 04 21:16:46.054615 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:16:46.058128 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:16:46.148126 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:16:46.214377 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:16:47.820496 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=32,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:57.071574 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] Terminate volume connection completed successfully. Jun 04 21:16:57.098996 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=37,cinder:INSERT=2,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:57.100049 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] Remove volume export completed successfully. Jun 04 21:16:57.178300 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-3d065472-61d6-4025-a119-ac331062b6cb-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:16:57.206616 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:16:57.322053 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:16:57.336378 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] deleting rbd volume volume-3d065472-61d6-4025-a119-ac331062b6cb {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:16:57.812024 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] Deleted volume successfully. Jun 04 21:16:57.817556 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-30acf6b8-2562-445c-8890-9828abb3bef5 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-3d065472-61d6-4025-a119-ac331062b6cb-delete_volume'" released by "delete_volume" :: held 0.639s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:16:58.953302 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:16:59.031105 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Flow 'volume_create_manager' (b973ecad-342e-4faf-83d0-3a13978f0a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:16:59.039008 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c1a42f-2b99-4f93-87c3-484fdfb7c570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:59.117258 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c1a42f-2b99-4f93-87c3-484fdfb7c570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1930374490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f0af00c0-1332-46a0-b28a-878815945d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7752a37a5984bc99d2acfcc327fc14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:16:59Z,use_quota=True,user_id='bff665dac5de4530ab70f20ba2da386d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:59.143888 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1dc46a-7c2d-4e0a-b08f-191c250fbcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:59.160777 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1dc46a-7c2d-4e0a-b08f-191c250fbcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:59.180685 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4348e14-b968-4c3e-8cb5-fd557023d1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:59.197452 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4348e14-b968-4c3e-8cb5-fd557023d1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0af00c0-1332-46a0-b28a-878815945d12', 'volume_name': 'volume-f0af00c0-1332-46a0-b28a-878815945d12', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:59.221395 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127969cb-7909-4dd4-a4a1-bce1652d1927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:59.233823 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127969cb-7909-4dd4-a4a1-bce1652d1927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:59.250146 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c8d1d3-3183-4f52-85c9-cef255c44ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:59.253131 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Volume f0af00c0-1332-46a0-b28a-878815945d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0af00c0-1332-46a0-b28a-878815945d12', 'volume_size': 1} Jun 04 21:16:59.253711 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] creating volume 'volume-f0af00c0-1332-46a0-b28a-878815945d12' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:16:59.254680 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:16:59.458601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:16:59.459062 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:16:59.464892 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c8d1d3-3183-4f52-85c9-cef255c44ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0af00c0-1332-46a0-b28a-878815945d12', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:59.477879 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56aece2a-a64e-4d14-9386-3aa12f22bf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:16:59.507822 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Volume volume-f0af00c0-1332-46a0-b28a-878815945d12 (f0af00c0-1332-46a0-b28a-878815945d12): created successfully Jun 04 21:16:59.512988 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56aece2a-a64e-4d14-9386-3aa12f22bf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:16:59.524306 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Flow 'volume_create_manager' (b973ecad-342e-4faf-83d0-3a13978f0a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:16:59.555064 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-eecb96aa-2331-4d34-8ae5-cba1371cbf9e tempest-AttachVolumeShelveTestJSON-1155730873 None] Created volume successfully. Jun 04 21:17:25.057643 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:29.766740 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:29.815397 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:17:29.879148 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (7ede30ac-1d8a-47bf-9fc7-6c71cfdd0d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:17:29.928361 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc93c8d-52f8-4e20-86a4-80f54796112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:30.001470 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc93c8d-52f8-4e20-86a4-80f54796112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-954129362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3653e205-45ec-46b3-95f9-bebd5c89c493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e56305a8994e3ca45920448336ba18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:17:30Z,use_quota=True,user_id='59e619953f32406891051e0e029c1670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:30.016539 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8616c1e7-5cd5-4804-ac00-6f8c021ea1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:30.028128 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8616c1e7-5cd5-4804-ac00-6f8c021ea1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:30.035486 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535de681-c7ae-4a22-a7a3-745b8193a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:30.151019 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535de681-c7ae-4a22-a7a3-745b8193a014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3653e205-45ec-46b3-95f9-bebd5c89c493', 'volume_name': 'volume-3653e205-45ec-46b3-95f9-bebd5c89c493', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:30.156414 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ada94d3-3305-4e14-8fc2-3e1f2ccc6516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:30.163640 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ada94d3-3305-4e14-8fc2-3e1f2ccc6516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:30.177601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220c77db-dd91-47e2-bc41-aaa6b426f8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:30.180823 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume 3653e205-45ec-46b3-95f9-bebd5c89c493: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3653e205-45ec-46b3-95f9-bebd5c89c493', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:17:30.181551 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Cloning 3653e205-45ec-46b3-95f9-bebd5c89c493 from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:17:30.198355 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:17:30.225870 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 17, 30, 208419)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:17:30.226431 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:17:30.226914 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:17:30.232604 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.034s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:17:30.233609 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:17:30.241734 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 17, 30, 237532)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:17:30.242247 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:17:30.243307 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:17:30.288120 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:30.413133 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] creating snapshot='volume-3653e205-45ec-46b3-95f9-bebd5c89c493.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:17:30.844373 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-3653e205-45ec-46b3-95f9-bebd5c89c493.clone_snap' to 'volume-3653e205-45ec-46b3-95f9-bebd5c89c493' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:17:31.112603 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:17:31.113977 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:17:31.114993 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:17:31.163157 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:17:31.164383 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Marking volume 3653e205-45ec-46b3-95f9-bebd5c89c493 as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:17:31.190186 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 3653e205-45ec-46b3-95f9-bebd5c89c493. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:17:31.206993 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Creating volume glance metadata for volume 3653e205-45ec-46b3-95f9-bebd5c89c493 backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:17:31.409308 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220c77db-dd91-47e2-bc41-aaa6b426f8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3653e205-45ec-46b3-95f9-bebd5c89c493', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:31.421875 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694e0a67-b6a2-4265-9c6c-afd182e4498a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:31.451957 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume volume-3653e205-45ec-46b3-95f9-bebd5c89c493 (3653e205-45ec-46b3-95f9-bebd5c89c493): created successfully Jun 04 21:17:31.456090 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694e0a67-b6a2-4265-9c6c-afd182e4498a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:31.467132 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (7ede30ac-1d8a-47bf-9fc7-6c71cfdd0d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:17:31.496663 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-83aa7fc0-e12a-4f63-b909-c30b26021322 tempest-VolumesSnapshotTestJSON-1648955989 None] Created volume successfully. Jun 04 21:17:31.924759 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:17:32.007597 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (b3e8c976-1a31-4617-9db5-891fce3b1dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:17:32.023382 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786841dd-d21b-4c9f-a716-a5df11d207c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:32.060524 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786841dd-d21b-4c9f-a716-a5df11d207c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-467825597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5fc46464-ed5a-4bd6-9f52-0314679e14cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6af5f33fb64a17906872b7edb1e049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:17:32Z,use_quota=True,user_id='2356361a22724a45a9213f5b1b4b71fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:32.093674 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe67df2-f1be-4a44-b000-09b0c7989aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:32.106215 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe67df2-f1be-4a44-b000-09b0c7989aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:32.128480 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27a4ea5-2b3b-4960-bc83-035bbc0f9175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:32.386466 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27a4ea5-2b3b-4960-bc83-035bbc0f9175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5fc46464-ed5a-4bd6-9f52-0314679e14cb', 'volume_name': 'volume-5fc46464-ed5a-4bd6-9f52-0314679e14cb', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:32.394275 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b9fba2-8194-44dc-b8f8-62f540d897dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:32.399310 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b9fba2-8194-44dc-b8f8-62f540d897dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:32.405088 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da88c2a-dcfe-4681-ad3e-4006eb6eff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:32.407109 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Volume 5fc46464-ed5a-4bd6-9f52-0314679e14cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5fc46464-ed5a-4bd6-9f52-0314679e14cb', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:17:32.407880 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Cloning 5fc46464-ed5a-4bd6-9f52-0314679e14cb from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:17:32.417365 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:17:32.449801 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 17, 32, 433718)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:17:32.450623 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:17:32.451212 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:17:32.457225 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.040s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:17:32.458344 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:17:32.466184 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 17, 32, 463029)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:17:32.467235 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:17:32.467891 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:17:32.497426 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:32.640569 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] creating snapshot='volume-5fc46464-ed5a-4bd6-9f52-0314679e14cb.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:17:33.452483 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-5fc46464-ed5a-4bd6-9f52-0314679e14cb.clone_snap' to 'volume-5fc46464-ed5a-4bd6-9f52-0314679e14cb' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:17:33.702406 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:17:33.703942 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:17:33.704640 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:17:33.758558 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:17:33.760472 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Marking volume 5fc46464-ed5a-4bd6-9f52-0314679e14cb as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:17:33.782983 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 5fc46464-ed5a-4bd6-9f52-0314679e14cb. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:17:33.783887 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Creating volume glance metadata for volume 5fc46464-ed5a-4bd6-9f52-0314679e14cb backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:17:33.962957 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da88c2a-dcfe-4681-ad3e-4006eb6eff39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc46464-ed5a-4bd6-9f52-0314679e14cb', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:33.971091 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14dbd39-0fe3-4fea-b4e0-fb76de60e9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:34.035824 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Volume volume-5fc46464-ed5a-4bd6-9f52-0314679e14cb (5fc46464-ed5a-4bd6-9f52-0314679e14cb): created successfully Jun 04 21:17:34.055468 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14dbd39-0fe3-4fea-b4e0-fb76de60e9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:34.084006 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (b3e8c976-1a31-4617-9db5-891fce3b1dbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:17:34.118493 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-992272cf-3101-4c10-b459-af3c605d0a7a tempest-TestVolumeBootPattern-524389578 None] Created volume successfully. Jun 04 21:17:34.734147 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 req-ef1af4d3-e0c8-485e-be55-e310cf98c807 tempest-VolumesSnapshotTestJSON-1648955989 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:17:35.807068 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f5db39f1-3125-47d6-8fe3-55b225de0394 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:36.384971 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 req-ef1af4d3-e0c8-485e-be55-e310cf98c807 tempest-VolumesSnapshotTestJSON-1648955989 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.651s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:17:36.386840 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 req-ef1af4d3-e0c8-485e-be55-e310cf98c807 tempest-VolumesSnapshotTestJSON-1648955989 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3653e205-45ec-46b3-95f9-bebd5c89c493', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '3653e205-45ec-46b3-95f9-bebd5c89c493', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:17:36.465059 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 req-ef1af4d3-e0c8-485e-be55-e310cf98c807 tempest-VolumesSnapshotTestJSON-1648955989 None] Connection info returned from driver {'name': 'volumes/volume-3653e205-45ec-46b3-95f9-bebd5c89c493', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3653e205-45ec-46b3-95f9-bebd5c89c493', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '73381fec-2827-4795-a2f5-c7c94a5deb68'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:17:36.637169 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 req-ef1af4d3-e0c8-485e-be55-e310cf98c807 tempest-VolumesSnapshotTestJSON-1648955989 None] attachment_update completed successfully. Jun 04 21:17:36.937218 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f5db39f1-3125-47d6-8fe3-55b225de0394 tempest-TestVolumeBootPattern-524389578 None] Create snapshot completed successfully Jun 04 21:17:39.262144 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7e2f0779-8aa4-4ed0-b230-f8be99deac8a tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:39.940360 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-7e2f0779-8aa4-4ed0-b230-f8be99deac8a tempest-VolumesSnapshotTestJSON-1648955989 None] Create snapshot completed successfully Jun 04 21:17:40.788461 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e8abf5f1-0396-44a5-8e9c-6efa350fc364 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:42.062543 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=72,cinder:UPDATE=10,cinder:INSERT=15,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:42.122395 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=55,cinder:UPDATE=11,cinder:INSERT=33,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:42.183237 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e8abf5f1-0396-44a5-8e9c-6efa350fc364 tempest-VolumesSnapshotTestJSON-1648955989 None] Create snapshot completed successfully Jun 04 21:17:42.907475 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:17:42.962642 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (4ccfdd2c-4b16-429a-af9d-60c3da0362f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:17:42.970202 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8d5ad6-c96e-45b2-a455-bbc54f254a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:42.989356 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8d5ad6-c96e-45b2-a455-bbc54f254a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:17:42Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4beec62a-24c2-4a34-8eab-4f94bf9a740f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6af5f33fb64a17906872b7edb1e049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4138dc87-e3fb-498c-9009-16923484c128,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:17:43Z,use_quota=True,user_id='2356361a22724a45a9213f5b1b4b71fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:42.996161 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8157f2c8-e9d8-4da2-b729-b3ff97b2f005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:43.006955 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8157f2c8-e9d8-4da2-b729-b3ff97b2f005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:43.013439 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f41c73e3-c318-4b4e-a0f2-20cdaf09f3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:43.018372 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f41c73e3-c318-4b4e-a0f2-20cdaf09f3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4beec62a-24c2-4a34-8eab-4f94bf9a740f', 'volume_name': 'volume-4beec62a-24c2-4a34-8eab-4f94bf9a740f', 'volume_size': 1, 'snapshot_id': '4138dc87-e3fb-498c-9009-16923484c128'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:43.023612 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42ab38b-a7b5-4900-8c38-33bd568fbe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:43.030643 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42ab38b-a7b5-4900-8c38-33bd568fbe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:43.035580 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c388c221-360c-46c1-9093-3a386ce4f9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:43.036978 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Volume 4beec62a-24c2-4a34-8eab-4f94bf9a740f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4beec62a-24c2-4a34-8eab-4f94bf9a740f', 'volume_size': 1, 'snapshot_id': '4138dc87-e3fb-498c-9009-16923484c128'} Jun 04 21:17:43.071910 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] cloning volumes/volume-5fc46464-ed5a-4bd6-9f52-0314679e14cb@snapshot-4138dc87-e3fb-498c-9009-16923484c128 to volume-4beec62a-24c2-4a34-8eab-4f94bf9a740f {{(pid=130490) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} Jun 04 21:17:43.073371 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:43.190020 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:43.398304 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e6bfbf4a-b5ed-49c1-bc98-751236d0d920 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:43.555892 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:17:43.556818 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:17:43.586315 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Marking volume 4beec62a-24c2-4a34-8eab-4f94bf9a740f as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:17:43.605856 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Copying metadata from snapshot 4138dc87-e3fb-498c-9009-16923484c128 to 4beec62a-24c2-4a34-8eab-4f94bf9a740f. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jun 04 21:17:43.691072 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c388c221-360c-46c1-9093-3a386ce4f9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4beec62a-24c2-4a34-8eab-4f94bf9a740f', 'volume_size': 1, 'snapshot_id': '4138dc87-e3fb-498c-9009-16923484c128'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:43.699082 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb20bc3-caa9-42fd-b531-c35d249633f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:43.713493 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Volume volume-4beec62a-24c2-4a34-8eab-4f94bf9a740f (4beec62a-24c2-4a34-8eab-4f94bf9a740f): created successfully Jun 04 21:17:43.721102 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb20bc3-caa9-42fd-b531-c35d249633f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:43.732606 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (4ccfdd2c-4b16-429a-af9d-60c3da0362f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:17:43.774661 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-a5494158-6a2b-44e1-ab16-59f2c8308717 tempest-TestVolumeBootPattern-524389578 None] Created volume successfully. Jun 04 21:17:44.093288 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e6bfbf4a-b5ed-49c1-bc98-751236d0d920 tempest-VolumesSnapshotTestJSON-1648955989 None] Create snapshot completed successfully Jun 04 21:17:44.423789 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-30f27b61-a05d-4eb1-aac9-adb2ee0a0007 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-7d9313cd-4ec1-43d1-8c53-e6efda4187b3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:17:44.429413 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-30f27b61-a05d-4eb1-aac9-adb2ee0a0007 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:46.053849 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:17:46.055288 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:46.107713 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:46.149374 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:17:46.258092 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-2baac187-e960-42db-b6b9-97f22a862dfe tempest-TestVolumeBootPattern-524389578 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:17:46.922789 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:17:46.962923 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Flow 'volume_create_manager' (6da41a31-1059-41bb-a125-2b1fe5c89526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:17:46.972611 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92ecf3f-21d3-44ec-b99a-c3511e847a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:46.993266 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92ecf3f-21d3-44ec-b99a-c3511e847a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1124951211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7fe8198-874e-43d3-a4d1-dab0d2d569d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941319569ea44243830f9f524a04f769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:17:47Z,use_quota=True,user_id='54bf05edabd042a9ae88038c25509d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6def7a3e-c653-4fbf-b6d7-800e11f5623f),volume_type_id=6def7a3e-c653-4fbf-b6d7-800e11f5623f)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:47.000579 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee58ccc-922f-4fc9-94d3-cf7ff797b1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:47.004860 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee58ccc-922f-4fc9-94d3-cf7ff797b1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:47.010729 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14fe929-7a86-4245-8243-0bd0870138dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:47.016687 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14fe929-7a86-4245-8243-0bd0870138dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7fe8198-874e-43d3-a4d1-dab0d2d569d4', 'volume_name': 'volume-f7fe8198-874e-43d3-a4d1-dab0d2d569d4', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:47.021948 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1712ae68-d3a9-4d78-a5c1-552b78af4852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:47.025962 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1712ae68-d3a9-4d78-a5c1-552b78af4852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:47.032024 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564f9811-75f5-4817-89b3-2eb2e0feb8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:47.033670 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Volume f7fe8198-874e-43d3-a4d1-dab0d2d569d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7fe8198-874e-43d3-a4d1-dab0d2d569d4', 'volume_size': 1} Jun 04 21:17:47.034341 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] creating volume 'volume-f7fe8198-874e-43d3-a4d1-dab0d2d569d4' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:17:47.035346 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:47.141345 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:17:47.142881 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:17:47.146894 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564f9811-75f5-4817-89b3-2eb2e0feb8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7fe8198-874e-43d3-a4d1-dab0d2d569d4', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:47.152385 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2378a27e-848c-47e1-8abd-736e57072602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:17:47.164447 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Volume volume-f7fe8198-874e-43d3-a4d1-dab0d2d569d4 (f7fe8198-874e-43d3-a4d1-dab0d2d569d4): created successfully Jun 04 21:17:47.169245 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2378a27e-848c-47e1-8abd-736e57072602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:17:47.174367 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Flow 'volume_create_manager' (6da41a31-1059-41bb-a125-2b1fe5c89526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:17:47.184092 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-373915a3-7dd4-453a-8915-1248576744a0 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Created volume successfully. Jun 04 21:17:47.211101 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-2baac187-e960-42db-b6b9-97f22a862dfe tempest-TestVolumeBootPattern-524389578 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.953s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:17:47.211809 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-2baac187-e960-42db-b6b9-97f22a862dfe tempest-TestVolumeBootPattern-524389578 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4beec62a-24c2-4a34-8eab-4f94bf9a740f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '4beec62a-24c2-4a34-8eab-4f94bf9a740f', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:17:47.234012 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-2baac187-e960-42db-b6b9-97f22a862dfe tempest-TestVolumeBootPattern-524389578 None] Connection info returned from driver {'name': 'volumes/volume-4beec62a-24c2-4a34-8eab-4f94bf9a740f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4beec62a-24c2-4a34-8eab-4f94bf9a740f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6314a613-5c5e-4ffd-90e4-53ecafeed24d'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:17:47.288338 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-04595ef9-a8a8-4902-9863-e495344f0da1 req-2baac187-e960-42db-b6b9-97f22a862dfe tempest-TestVolumeBootPattern-524389578 None] attachment_update completed successfully. Jun 04 21:17:48.493535 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f8023f46-6b8e-40ec-9da6-d4b247613bd1 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:48.531368 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f8023f46-6b8e-40ec-9da6-d4b247613bd1 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:48.555973 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-f8023f46-6b8e-40ec-9da6-d4b247613bd1 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:17:48.560343 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f8023f46-6b8e-40ec-9da6-d4b247613bd1 tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Retype volume completed successfully. Jun 04 21:17:49.833137 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Lock "b'cinder-f7fe8198-874e-43d3-a4d1-dab0d2d569d4-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:17:49.902286 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:49.999464 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:17:50.000020 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Volume volume-f7fe8198-874e-43d3-a4d1-dab0d2d569d4 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:17:50.008655 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] deleting rbd volume volume-f7fe8198-874e-43d3-a4d1-dab0d2d569d4 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:17:50.272334 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:17:50.273107 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:17:50.288694 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Created reservations ['7486b444-1f9f-49f2-9fcf-a2c7b41b1d81', '96aa1754-900f-4e68-8602-b8e93763dd01', '4dd4ba77-7a8f-451e-945b-cc1501ebd66a', '2e047c71-0c56-4012-a400-28b536a22d79'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:17:50.328064 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:INSERT=20,cinder:SELECT=59,cinder:UPDATE=18,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:50.348304 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:50.425725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:17:50.488357 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:17:50.507029 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Deleted volume successfully. Jun 04 21:17:50.510045 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=58,cinder:UPDATE=21,cinder:INSERT=20,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:50.531787 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-bc4c39d4-0fa2-4a72-a0f1-62c3c3c8ddff tempest-VolumeRetypeWithoutMigrationTest-7653974 None] Lock "b'cinder-f7fe8198-874e-43d3-a4d1-dab0d2d569d4-delete_volume'" released by "delete_volume" :: held 0.699s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:17:51.114498 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f req-5ddd1345-f25a-453f-acd4-68e2df44b551 tempest-AttachVolumeShelveTestJSON-1155730873 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:17:51.986961 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f req-5ddd1345-f25a-453f-acd4-68e2df44b551 tempest-AttachVolumeShelveTestJSON-1155730873 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.872s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:17:51.989451 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f req-5ddd1345-f25a-453f-acd4-68e2df44b551 tempest-AttachVolumeShelveTestJSON-1155730873 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f0af00c0-1332-46a0-b28a-878815945d12', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'f0af00c0-1332-46a0-b28a-878815945d12', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:17:52.061364 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f req-5ddd1345-f25a-453f-acd4-68e2df44b551 tempest-AttachVolumeShelveTestJSON-1155730873 None] Connection info returned from driver {'name': 'volumes/volume-f0af00c0-1332-46a0-b28a-878815945d12', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f0af00c0-1332-46a0-b28a-878815945d12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cf0b830b-736d-4b7e-a538-3403ecada53a'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:17:52.154492 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f req-5ddd1345-f25a-453f-acd4-68e2df44b551 tempest-AttachVolumeShelveTestJSON-1155730873 None] attachment_update completed successfully. Jun 04 21:18:01.686678 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:18:01.721403 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Flow 'volume_create_manager' (cc5f8aca-7169-47d8-aa6a-509abb4f7c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:01.728175 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d134b4-be92-46a5-819e-b7cfcbe0b87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:01.745840 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d134b4-be92-46a5-819e-b7cfcbe0b87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-322612844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9768e2d1-7256-4489-b868-818e2bbb7200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce38e77bab94c85a10d14d424bbd255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:18:02Z,use_quota=True,user_id='4d5a489be63544e084bf03c64e3ebab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:01.751488 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a71eca6-a81b-4011-8506-933ea3b3a892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:01.755598 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a71eca6-a81b-4011-8506-933ea3b3a892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:01.760612 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3edff6-8acc-4719-889e-1fd609953b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:01.764650 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3edff6-8acc-4719-889e-1fd609953b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9768e2d1-7256-4489-b868-818e2bbb7200', 'volume_name': 'volume-9768e2d1-7256-4489-b868-818e2bbb7200', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:01.769740 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5553ff72-4c1e-4675-a31a-398c2e738a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:01.774074 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5553ff72-4c1e-4675-a31a-398c2e738a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:01.779055 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4449546-7a64-47d3-acc2-68eab1b1339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:01.780476 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Volume 9768e2d1-7256-4489-b868-818e2bbb7200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9768e2d1-7256-4489-b868-818e2bbb7200', 'volume_size': 1} Jun 04 21:18:01.781134 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] creating volume 'volume-9768e2d1-7256-4489-b868-818e2bbb7200' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:18:01.782279 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:01.903294 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:18:01.903788 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:18:01.907408 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4449546-7a64-47d3-acc2-68eab1b1339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9768e2d1-7256-4489-b868-818e2bbb7200', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:01.912134 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9745d77-8ef6-4245-a5d1-25726a0b0e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:01.953873 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Volume volume-9768e2d1-7256-4489-b868-818e2bbb7200 (9768e2d1-7256-4489-b868-818e2bbb7200): created successfully Jun 04 21:18:01.963764 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9745d77-8ef6-4245-a5d1-25726a0b0e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:01.974831 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Flow 'volume_create_manager' (cc5f8aca-7169-47d8-aa6a-509abb4f7c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:02.018313 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-bb9dfb08-2d12-4c44-9648-c3c2cbb0f47a tempest-VolumesTransfersV355Test-1004886289 None] Created volume successfully. Jun 04 21:18:03.805096 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1cd520ed-3b57-4679-8a8c-2e8a62169900 tempest-VolumesTransfersV355Test-1457647534 None] Transfer volume completed successfully. Jun 04 21:18:04.322096 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d8aea973-203a-408a-b4ce-7aab738a69e2 tempest-VolumesTransfersV355Test-870787418 None] Lock "b'cinder-9768e2d1-7256-4489-b868-818e2bbb7200-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:04.351346 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d8aea973-203a-408a-b4ce-7aab738a69e2 tempest-VolumesTransfersV355Test-870787418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:04.406294 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d8aea973-203a-408a-b4ce-7aab738a69e2 tempest-VolumesTransfersV355Test-870787418 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:18:04.406851 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d8aea973-203a-408a-b4ce-7aab738a69e2 tempest-VolumesTransfersV355Test-870787418 None] Volume volume-9768e2d1-7256-4489-b868-818e2bbb7200 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:18:04.413414 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d8aea973-203a-408a-b4ce-7aab738a69e2 tempest-VolumesTransfersV355Test-870787418 None] deleting rbd volume volume-9768e2d1-7256-4489-b868-818e2bbb7200 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:18:04.682993 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-d8aea973-203a-408a-b4ce-7aab738a69e2 tempest-VolumesTransfersV355Test-870787418 None] Created reservations ['8e8f0848-e962-4add-b3e6-d18953b6a392', 'ef09bfff-37d9-4fe8-99c7-464ddf7bfa23', '47e48d94-6315-4efe-895b-22ad34f8996b', '7b269aa4-d23d-48ea-9062-7b153c0924a6'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:04.730225 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d8aea973-203a-408a-b4ce-7aab738a69e2 tempest-VolumesTransfersV355Test-870787418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:04.751945 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d8aea973-203a-408a-b4ce-7aab738a69e2 tempest-VolumesTransfersV355Test-870787418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:04.777867 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-d8aea973-203a-408a-b4ce-7aab738a69e2 tempest-VolumesTransfersV355Test-870787418 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:18:04.782900 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-d8aea973-203a-408a-b4ce-7aab738a69e2 tempest-VolumesTransfersV355Test-870787418 None] Deleted volume successfully. Jun 04 21:18:04.797294 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d8aea973-203a-408a-b4ce-7aab738a69e2 tempest-VolumesTransfersV355Test-870787418 None] Lock "b'cinder-9768e2d1-7256-4489-b868-818e2bbb7200-delete_volume'" released by "delete_volume" :: held 0.475s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:05.750768 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:18:05.773452 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Flow 'volume_create_manager' (01714929-a07a-428e-a74d-4e912d94a1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:05.783343 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eebd940-e06e-492a-a961-1624ffae5b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:05.800347 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eebd940-e06e-492a-a961-1624ffae5b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1585327298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7f4bcf11-cfee-489f-94c9-1f0b87f6011f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce38e77bab94c85a10d14d424bbd255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:18:06Z,use_quota=True,user_id='4d5a489be63544e084bf03c64e3ebab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:05.805770 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373a1c12-8f4a-46b2-8e9d-618fa6cdc426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:05.809990 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373a1c12-8f4a-46b2-8e9d-618fa6cdc426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:05.814832 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e385cdde-8572-4f1b-bb2a-a040daed9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:05.818730 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e385cdde-8572-4f1b-bb2a-a040daed9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4bcf11-cfee-489f-94c9-1f0b87f6011f', 'volume_name': 'volume-7f4bcf11-cfee-489f-94c9-1f0b87f6011f', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:05.823422 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d6516d-d6bd-419d-a0b9-f43fd4828a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:05.827386 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d6516d-d6bd-419d-a0b9-f43fd4828a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:05.831949 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a0a875-226f-4a7c-b1d9-e2d535f5a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:05.833004 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Volume 7f4bcf11-cfee-489f-94c9-1f0b87f6011f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4bcf11-cfee-489f-94c9-1f0b87f6011f', 'volume_size': 1} Jun 04 21:18:05.833394 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] creating volume 'volume-7f4bcf11-cfee-489f-94c9-1f0b87f6011f' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:18:05.834667 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:05.907548 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:18:05.908197 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:18:05.913449 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a0a875-226f-4a7c-b1d9-e2d535f5a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4bcf11-cfee-489f-94c9-1f0b87f6011f', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:05.918422 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f905794c-34df-472d-9fab-51759a9aee11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:05.929243 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Volume volume-7f4bcf11-cfee-489f-94c9-1f0b87f6011f (7f4bcf11-cfee-489f-94c9-1f0b87f6011f): created successfully Jun 04 21:18:05.932998 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f905794c-34df-472d-9fab-51759a9aee11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:05.938715 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Flow 'volume_create_manager' (01714929-a07a-428e-a74d-4e912d94a1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:05.949712 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-12659590-ada8-4abf-a31e-4f6f4d881890 tempest-VolumesTransfersV355Test-1004886289 None] Created volume successfully. Jun 04 21:18:06.403156 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-6a8d0054-a5cb-4baf-bffe-22b1ed0cc0ac tempest-TestVolumeBootPattern-524389578 None] Terminate volume connection completed successfully. Jun 04 21:18:06.403594 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-6a8d0054-a5cb-4baf-bffe-22b1ed0cc0ac tempest-TestVolumeBootPattern-524389578 None] Deleting attachment 6314a613-5c5e-4ffd-90e4-53ecafeed24d. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:18:07.121177 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-a18e46c5-a5d6-4f47-8fd6-113f26b452c5 tempest-VolumesTransfersV355Test-870787418 None] Lock "b'cinder-7f4bcf11-cfee-489f-94c9-1f0b87f6011f-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:07.161837 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a18e46c5-a5d6-4f47-8fd6-113f26b452c5 tempest-VolumesTransfersV355Test-870787418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:07.211548 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a18e46c5-a5d6-4f47-8fd6-113f26b452c5 tempest-VolumesTransfersV355Test-870787418 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:18:07.211920 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a18e46c5-a5d6-4f47-8fd6-113f26b452c5 tempest-VolumesTransfersV355Test-870787418 None] Volume volume-7f4bcf11-cfee-489f-94c9-1f0b87f6011f is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:18:07.221404 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a18e46c5-a5d6-4f47-8fd6-113f26b452c5 tempest-VolumesTransfersV355Test-870787418 None] deleting rbd volume volume-7f4bcf11-cfee-489f-94c9-1f0b87f6011f {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:18:07.252467 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-35fc6f06-c7bb-416f-be81-7073376d9b0c tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-4beec62a-24c2-4a34-8eab-4f94bf9a740f-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:07.296966 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-35fc6f06-c7bb-416f-be81-7073376d9b0c tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:07.410521 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-35fc6f06-c7bb-416f-be81-7073376d9b0c tempest-TestVolumeBootPattern-524389578 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:18:07.428456 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-35fc6f06-c7bb-416f-be81-7073376d9b0c tempest-TestVolumeBootPattern-524389578 None] deleting rbd volume volume-4beec62a-24c2-4a34-8eab-4f94bf9a740f {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:18:07.546154 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-a18e46c5-a5d6-4f47-8fd6-113f26b452c5 tempest-VolumesTransfersV355Test-870787418 None] Created reservations ['90c7f1d9-54fa-49c5-8677-a0d5808b4ee5', '26ce6334-760b-48d0-9b7e-9ea37fe727a7', '77849c31-3aa8-4c7c-b56b-183595bc8bd7', 'f6579970-1fe9-40ef-9f11-aa2c0ca6e90c'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:07.594337 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a18e46c5-a5d6-4f47-8fd6-113f26b452c5 tempest-VolumesTransfersV355Test-870787418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:07.630252 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a18e46c5-a5d6-4f47-8fd6-113f26b452c5 tempest-VolumesTransfersV355Test-870787418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:07.694213 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-a18e46c5-a5d6-4f47-8fd6-113f26b452c5 tempest-VolumesTransfersV355Test-870787418 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:18:07.712186 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a18e46c5-a5d6-4f47-8fd6-113f26b452c5 tempest-VolumesTransfersV355Test-870787418 None] Deleted volume successfully. Jun 04 21:18:07.731175 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-a18e46c5-a5d6-4f47-8fd6-113f26b452c5 tempest-VolumesTransfersV355Test-870787418 None] Lock "b'cinder-7f4bcf11-cfee-489f-94c9-1f0b87f6011f-delete_volume'" released by "delete_volume" :: held 0.610s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:07.794562 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-35fc6f06-c7bb-416f-be81-7073376d9b0c tempest-TestVolumeBootPattern-524389578 None] Created reservations ['472b53f8-3753-4c3a-852a-7c13ade01558', 'e70eabd2-ed0d-4427-aa93-cd3930555e79', '23cba33f-1fba-4fa8-a0be-c15cba86f3ec', 'b2cedc42-3ec9-4def-bd09-cdf13f753f37'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:07.848479 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-35fc6f06-c7bb-416f-be81-7073376d9b0c tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:07.892267 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-35fc6f06-c7bb-416f-be81-7073376d9b0c tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:07.928237 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-35fc6f06-c7bb-416f-be81-7073376d9b0c tempest-TestVolumeBootPattern-524389578 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:18:07.932672 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-35fc6f06-c7bb-416f-be81-7073376d9b0c tempest-TestVolumeBootPattern-524389578 None] Deleted volume successfully. Jun 04 21:18:07.953683 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-f4f12467-cab8-4bc6-abff-b429509cee97 req-35fc6f06-c7bb-416f-be81-7073376d9b0c tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-4beec62a-24c2-4a34-8eab-4f94bf9a740f-delete_volume'" released by "delete_volume" :: held 0.700s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:08.136567 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f00549e9-1727-40c6-8b5d-59de2c65023a tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-4138dc87-e3fb-498c-9009-16923484c128-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:08.138236 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f00549e9-1727-40c6-8b5d-59de2c65023a tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:08.692581 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:DELETE=3,cinder:SELECT=61,cinder:UPDATE=29,cinder:INSERT=7 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:08.713663 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=62,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:08.750412 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-f00549e9-1727-40c6-8b5d-59de2c65023a tempest-TestVolumeBootPattern-524389578 None] Created reservations ['cede13a8-fa20-4bbe-9b43-3993cbce9909', '1bbbde7f-c066-4477-aef9-620251d23aa6', 'd3aa08b8-2f9b-482f-abd8-d35fa5c3d2e1', '74fe7313-9695-4954-a50e-9049bfea3297'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:08.797729 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f00549e9-1727-40c6-8b5d-59de2c65023a tempest-TestVolumeBootPattern-524389578 None] Delete snapshot completed successfully. Jun 04 21:18:08.802326 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f00549e9-1727-40c6-8b5d-59de2c65023a tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-4138dc87-e3fb-498c-9009-16923484c128-delete_snapshot'" released by "delete_snapshot" :: held 0.666s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:09.269345 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-5fc46464-ed5a-4bd6-9f52-0314679e14cb-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:09.313479 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:09.396386 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:18:09.405478 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] deleting rbd volume volume-5fc46464-ed5a-4bd6-9f52-0314679e14cb {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:18:09.715919 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:18:09.769378 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] deleting parent snapshot volume-5fc46464-ed5a-4bd6-9f52-0314679e14cb.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:18:10.807037 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] Created reservations ['1e00cc77-3bb6-4266-adbb-abb31730fcf1', 'bde95f44-88fb-4a19-aeb9-5c505ac9e5d7', '5e7936e1-e935-4025-8450-9c247651c4a6', '0f10ed47-8ffd-4d35-8820-35e95e146a76'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:10.854106 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:10.895380 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:10.934894 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:18:10.942563 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] Deleted volume successfully. Jun 04 21:18:10.956459 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-9ce3a6c3-1594-4590-b6a3-544871f1e69b tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-5fc46464-ed5a-4bd6-9f52-0314679e14cb-delete_volume'" released by "delete_volume" :: held 1.687s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:12.058772 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:18:12.078966 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (c5b40b86-b5e3-4f93-a0da-06302fac5273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:12.085589 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec428dbe-b2fc-4f42-9e72-23b77a4a10c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:12.112411 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec428dbe-b2fc-4f42-9e72-23b77a4a10c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1311907662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a03e5283-6e7a-4d35-ba39-48cc091eeeba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6af5f33fb64a17906872b7edb1e049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:18:12Z,use_quota=True,user_id='2356361a22724a45a9213f5b1b4b71fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:12.117471 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5db1c5-0e69-4659-9f61-6fd2d2d27092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:12.122067 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5db1c5-0e69-4659-9f61-6fd2d2d27092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:12.126885 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748f8f68-9602-40bc-8227-55ba24767e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:12.141472 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:18:12.162207 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Flow 'volume_create_manager' (8eb47bcc-5c67-440b-b724-6c4da9f565d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:12.169132 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6d7a4b-26fe-44f8-aaf1-aa4166bace78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:12.191084 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6d7a4b-26fe-44f8-aaf1-aa4166bace78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-37524208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3c2f970e-93da-4981-8ff1-5b6a7f3edb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c417b1fc0ad4165bbdc7241d6a121b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:18:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:18:12Z,use_quota=True,user_id='c24c494c63bc4a7db02c60e5421175dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:12.196243 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690214c7-5e53-4b13-a4d0-f3592af0deed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:12.200854 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690214c7-5e53-4b13-a4d0-f3592af0deed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:12.205676 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e874b4be-66c6-4cc2-9ec7-b9db68cffed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:12.209545 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e874b4be-66c6-4cc2-9ec7-b9db68cffed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c2f970e-93da-4981-8ff1-5b6a7f3edb22', 'volume_name': 'volume-3c2f970e-93da-4981-8ff1-5b6a7f3edb22', 'volume_size': 2}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:12.214690 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392159a2-ba1a-4ff5-86ba-80eba938342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:12.218433 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392159a2-ba1a-4ff5-86ba-80eba938342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:12.222882 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a43f4c1-e995-418d-85bb-aaf04525df86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:12.223947 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Volume 3c2f970e-93da-4981-8ff1-5b6a7f3edb22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c2f970e-93da-4981-8ff1-5b6a7f3edb22', 'volume_size': 2} Jun 04 21:18:12.224335 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] creating volume 'volume-3c2f970e-93da-4981-8ff1-5b6a7f3edb22' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:18:12.225097 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:12.293569 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:18:12.293974 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:18:12.297687 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a43f4c1-e995-418d-85bb-aaf04525df86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2f970e-93da-4981-8ff1-5b6a7f3edb22', 'volume_size': 2}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:12.302029 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd3c964-0607-4c3c-afca-207022892eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:12.321147 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Volume volume-3c2f970e-93da-4981-8ff1-5b6a7f3edb22 (3c2f970e-93da-4981-8ff1-5b6a7f3edb22): created successfully Jun 04 21:18:12.325029 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd3c964-0607-4c3c-afca-207022892eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:12.330271 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Flow 'volume_create_manager' (8eb47bcc-5c67-440b-b724-6c4da9f565d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:12.338481 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748f8f68-9602-40bc-8227-55ba24767e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a03e5283-6e7a-4d35-ba39-48cc091eeeba', 'volume_name': 'volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:12.343274 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e694aa-cba8-4a0b-96c6-375f8e49e84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:12.347073 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e694aa-cba8-4a0b-96c6-375f8e49e84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:12.351602 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc584ed-1c18-4c90-9cee-ed18f2441b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:12.352850 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Volume a03e5283-6e7a-4d35-ba39-48cc091eeeba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:18:12.353464 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Cloning a03e5283-6e7a-4d35-ba39-48cc091eeeba from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:18:12.364137 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:12.366881 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e37c2651-54fc-4148-841c-ec028a3e4011 tempest-VolumesCloneNegativeTest-955509424 None] Created volume successfully. Jun 04 21:18:12.382344 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 18, 12, 372533)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:18:12.382958 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:18:12.383481 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:18:12.388458 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:12.389403 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:18:12.395816 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 18, 12, 393411)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:18:12.396224 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:18:12.396611 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:18:12.409503 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:12.463751 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] creating snapshot='volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:18:13.433178 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba.clone_snap' to 'volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:18:13.451706 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-de47d16a-0f6d-4abd-9dcb-fb397835d5a8 tempest-VolumesCloneNegativeTest-955509424 None] Lock "b'cinder-3c2f970e-93da-4981-8ff1-5b6a7f3edb22-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:13.508109 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-de47d16a-0f6d-4abd-9dcb-fb397835d5a8 tempest-VolumesCloneNegativeTest-955509424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:13.585029 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-de47d16a-0f6d-4abd-9dcb-fb397835d5a8 tempest-VolumesCloneNegativeTest-955509424 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:18:13.585610 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-de47d16a-0f6d-4abd-9dcb-fb397835d5a8 tempest-VolumesCloneNegativeTest-955509424 None] Volume volume-3c2f970e-93da-4981-8ff1-5b6a7f3edb22 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:18:13.601305 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-de47d16a-0f6d-4abd-9dcb-fb397835d5a8 tempest-VolumesCloneNegativeTest-955509424 None] deleting rbd volume volume-3c2f970e-93da-4981-8ff1-5b6a7f3edb22 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:18:13.658144 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:18:13.659678 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:18:13.660127 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:18:13.709741 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:18:13.710369 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Marking volume a03e5283-6e7a-4d35-ba39-48cc091eeeba as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:18:13.722856 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to a03e5283-6e7a-4d35-ba39-48cc091eeeba. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:18:13.723283 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Creating volume glance metadata for volume a03e5283-6e7a-4d35-ba39-48cc091eeeba backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:18:13.814774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc584ed-1c18-4c90-9cee-ed18f2441b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:13.820204 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39cde299-c574-4718-be2d-9e6f65170d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:13.839692 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Volume volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba (a03e5283-6e7a-4d35-ba39-48cc091eeeba): created successfully Jun 04 21:18:13.843715 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39cde299-c574-4718-be2d-9e6f65170d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:13.852480 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (c5b40b86-b5e3-4f93-a0da-06302fac5273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:13.875786 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c31b9146-d5ac-4a3e-a4c5-997c8a0f4eec tempest-TestVolumeBootPattern-524389578 None] Created volume successfully. Jun 04 21:18:14.037987 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-de47d16a-0f6d-4abd-9dcb-fb397835d5a8 tempest-VolumesCloneNegativeTest-955509424 None] Created reservations ['c080e2af-128c-4599-afdc-d251e678ad3c', 'e0c1edfc-d9ae-4832-85df-468808dd966b', 'fb2cd9c4-6639-457c-a14d-c110e815eba5', '54aed4fd-c9a2-47ee-857a-10c01538dca0'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:14.105038 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-de47d16a-0f6d-4abd-9dcb-fb397835d5a8 tempest-VolumesCloneNegativeTest-955509424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:14.152152 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-de47d16a-0f6d-4abd-9dcb-fb397835d5a8 tempest-VolumesCloneNegativeTest-955509424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:14.187493 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-de47d16a-0f6d-4abd-9dcb-fb397835d5a8 tempest-VolumesCloneNegativeTest-955509424 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:18:14.192439 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-de47d16a-0f6d-4abd-9dcb-fb397835d5a8 tempest-VolumesCloneNegativeTest-955509424 None] Deleted volume successfully. Jun 04 21:18:14.211163 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-de47d16a-0f6d-4abd-9dcb-fb397835d5a8 tempest-VolumesCloneNegativeTest-955509424 None] Lock "b'cinder-3c2f970e-93da-4981-8ff1-5b6a7f3edb22-delete_volume'" released by "delete_volume" :: held 0.759s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:14.653832 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-30f27b61-a05d-4eb1-aac9-adb2ee0a0007 tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['ca4f0d06-2b05-469e-a56a-5435c2c3a5d3', '490fbdbf-9458-4a57-9fb1-920d13a29241', 'bcf14e45-18ce-4088-ac62-717c13273eb2', '4c517df7-9e82-461b-9831-ff1b365b9062'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:14.668614 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=56,cinder:INSERT=13,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:14.686819 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=57,cinder:UPDATE=25,cinder:INSERT=15,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:14.707360 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-30f27b61-a05d-4eb1-aac9-adb2ee0a0007 tempest-VolumesSnapshotTestJSON-1648955989 None] Delete snapshot completed successfully. Jun 04 21:18:14.715627 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-30f27b61-a05d-4eb1-aac9-adb2ee0a0007 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-7d9313cd-4ec1-43d1-8c53-e6efda4187b3-delete_snapshot'" released by "delete_snapshot" :: held 30.292s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:15.120509 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f01da798-d629-420d-802e-5fdb555475f3 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-1970e5d6-921e-4859-ae7d-2926328b6f31-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:15.122690 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f01da798-d629-420d-802e-5fdb555475f3 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:16.572664 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:18:16.593420 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Flow 'volume_create_manager' (ec5ee528-836d-42e6-9a34-24ca8a5ddd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:16.599722 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627dc310-fae2-4dbd-bd5e-942901f5671c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:16.625100 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627dc310-fae2-4dbd-bd5e-942901f5671c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1490768504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2bc8d44-ba64-4b9b-8f8f-a5c802d04173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d221ae6f9e3d4de1b7babad7f3ff7b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:18:17Z,use_quota=True,user_id='0c291cf04f314fd3a551e3e8f76438c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:16.630115 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92982c79-bae3-4b67-9b90-53ef51e29011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:16.634149 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92982c79-bae3-4b67-9b90-53ef51e29011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:16.639170 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbeebe5-6024-4587-8f74-4b753dbde5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:16.649585 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-0b1b3106-4702-4ff1-ab2d-85513953b372 req-15957bd9-e2fe-499c-beab-97141aa3aac8 tempest-TestVolumeBootPattern-524389578 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:18:16.764113 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbeebe5-6024-4587-8f74-4b753dbde5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2bc8d44-ba64-4b9b-8f8f-a5c802d04173', 'volume_name': 'volume-b2bc8d44-ba64-4b9b-8f8f-a5c802d04173', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:16.772716 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab51325d-61f1-4ded-af72-8623c327144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:16.777681 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab51325d-61f1-4ded-af72-8623c327144c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:16.783810 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c61bc3-e0c0-4cd8-be7b-cec7fcf54005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:16.785181 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Volume b2bc8d44-ba64-4b9b-8f8f-a5c802d04173: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2bc8d44-ba64-4b9b-8f8f-a5c802d04173', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:18:16.785981 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Cloning b2bc8d44-ba64-4b9b-8f8f-a5c802d04173 from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:18:16.796510 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:16.810858 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 18, 16, 802696)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:18:16.811203 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:18:16.811668 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:18:16.821084 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:16.822505 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:18:16.829263 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 18, 16, 826910)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:18:16.829892 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:18:16.830365 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:18:16.844794 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:16.928700 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] creating snapshot='volume-b2bc8d44-ba64-4b9b-8f8f-a5c802d04173.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:18:17.544261 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-b2bc8d44-ba64-4b9b-8f8f-a5c802d04173.clone_snap' to 'volume-b2bc8d44-ba64-4b9b-8f8f-a5c802d04173' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:18:17.548178 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-0b1b3106-4702-4ff1-ab2d-85513953b372 req-15957bd9-e2fe-499c-beab-97141aa3aac8 tempest-TestVolumeBootPattern-524389578 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.897s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:18:17.549014 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-0b1b3106-4702-4ff1-ab2d-85513953b372 req-15957bd9-e2fe-499c-beab-97141aa3aac8 tempest-TestVolumeBootPattern-524389578 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'a03e5283-6e7a-4d35-ba39-48cc091eeeba', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:18:17.599615 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-0b1b3106-4702-4ff1-ab2d-85513953b372 req-15957bd9-e2fe-499c-beab-97141aa3aac8 tempest-TestVolumeBootPattern-524389578 None] Connection info returned from driver {'name': 'volumes/volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a03e5283-6e7a-4d35-ba39-48cc091eeeba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '465a6388-f413-4cf0-b67a-af84a3ae8cdc'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:18:17.666903 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-0b1b3106-4702-4ff1-ab2d-85513953b372 req-15957bd9-e2fe-499c-beab-97141aa3aac8 tempest-TestVolumeBootPattern-524389578 None] attachment_update completed successfully. Jun 04 21:18:17.741832 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:18:17.743552 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:18:17.744134 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:18:17.778047 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:18:17.778745 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Marking volume b2bc8d44-ba64-4b9b-8f8f-a5c802d04173 as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:18:17.790535 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to b2bc8d44-ba64-4b9b-8f8f-a5c802d04173. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:18:17.791284 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Creating volume glance metadata for volume b2bc8d44-ba64-4b9b-8f8f-a5c802d04173 backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:18:17.874053 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c61bc3-e0c0-4cd8-be7b-cec7fcf54005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2bc8d44-ba64-4b9b-8f8f-a5c802d04173', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:17.884407 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2e28df-76f2-4f7f-9150-273e09bd0458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:17.906415 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Volume volume-b2bc8d44-ba64-4b9b-8f8f-a5c802d04173 (b2bc8d44-ba64-4b9b-8f8f-a5c802d04173): created successfully Jun 04 21:18:17.925854 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2e28df-76f2-4f7f-9150-273e09bd0458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:17.935939 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Flow 'volume_create_manager' (ec5ee528-836d-42e6-9a34-24ca8a5ddd8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:17.977160 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4e0ef213-0e34-45a5-924f-5e326f484461 tempest-VolumesExtendTest-36044883 None] Created volume successfully. Jun 04 21:18:18.859136 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c89b8225-b63d-4399-bbc9-a2365f68e4b2 tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:19.007994 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c89b8225-b63d-4399-bbc9-a2365f68e4b2 tempest-VolumesExtendTest-36044883 None] Extend volume from 1 GB to 2 GB. {{(pid=130490) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1886}} Jun 04 21:18:19.043364 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c89b8225-b63d-4399-bbc9-a2365f68e4b2 tempest-VolumesExtendTest-36044883 None] Extend volume completed successfully. Jun 04 21:18:20.324117 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:18:20.351928 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Flow 'volume_create_manager' (9651b9dd-654f-4123-b452-d41c6f782563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:20.351928 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dcb44e-0c68-4e6c-800a-d3f7ba125636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:20.367429 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dcb44e-0c68-4e6c-800a-d3f7ba125636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1416904117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7e05663b-1774-4a58-8f86-1b6bf4967511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d221ae6f9e3d4de1b7babad7f3ff7b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:18:20Z,use_quota=True,user_id='0c291cf04f314fd3a551e3e8f76438c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:20.374400 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5aa65a9-674d-4c96-a120-794104e0471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:20.378571 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5aa65a9-674d-4c96-a120-794104e0471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:20.383972 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a747eec4-73c1-4764-b0d2-f8eeb627d1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:20.388397 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a747eec4-73c1-4764-b0d2-f8eeb627d1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e05663b-1774-4a58-8f86-1b6bf4967511', 'volume_name': 'volume-7e05663b-1774-4a58-8f86-1b6bf4967511', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:20.393382 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04359905-7c46-45ef-b29b-a1011a31dc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:20.397080 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04359905-7c46-45ef-b29b-a1011a31dc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:20.401666 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a07c429-c3d0-4544-9e19-2950322ce288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:20.402535 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Volume 7e05663b-1774-4a58-8f86-1b6bf4967511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e05663b-1774-4a58-8f86-1b6bf4967511', 'volume_size': 1} Jun 04 21:18:20.402913 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] creating volume 'volume-7e05663b-1774-4a58-8f86-1b6bf4967511' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:18:20.403717 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:20.467387 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:18:20.467795 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:18:20.471605 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a07c429-c3d0-4544-9e19-2950322ce288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e05663b-1774-4a58-8f86-1b6bf4967511', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:20.476040 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893994e6-dbba-4cdc-85c9-5067ad182c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:20.486989 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Volume volume-7e05663b-1774-4a58-8f86-1b6bf4967511 (7e05663b-1774-4a58-8f86-1b6bf4967511): created successfully Jun 04 21:18:20.490421 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893994e6-dbba-4cdc-85c9-5067ad182c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:20.496163 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Flow 'volume_create_manager' (9651b9dd-654f-4123-b452-d41c6f782563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:20.506553 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-04356597-1b69-4b31-a48b-693759b075ea tempest-VolumesExtendTest-36044883 None] Created volume successfully. Jun 04 21:18:21.586941 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b8b4f3c8-7feb-45f0-b229-68cc593aceee tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:22.512440 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b8b4f3c8-7feb-45f0-b229-68cc593aceee tempest-VolumesExtendTest-36044883 None] Create snapshot completed successfully Jun 04 21:18:22.693961 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-41f4e6ad-2178-41c9-85e1-49bc47c25b63 tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:22.785221 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-41f4e6ad-2178-41c9-85e1-49bc47c25b63 tempest-VolumesExtendTest-36044883 None] Extend volume from 1 GB to 2 GB. {{(pid=130490) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1886}} Jun 04 21:18:22.813997 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-41f4e6ad-2178-41c9-85e1-49bc47c25b63 tempest-VolumesExtendTest-36044883 None] Extend volume completed successfully. Jun 04 21:18:23.896020 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-fbec782e-71cf-4b21-a741-fd9596e2d4b6 tempest-VolumesExtendTest-36044883 None] Lock "b'cinder-fe8b3de4-0684-4619-8e02-6c72590badbe-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:23.897608 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fbec782e-71cf-4b21-a741-fd9596e2d4b6 tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:24.602432 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-fbec782e-71cf-4b21-a741-fd9596e2d4b6 tempest-VolumesExtendTest-36044883 None] Created reservations ['590564a8-f14d-4fd5-8f3a-8801213620a7', '4744ca45-67de-49a6-9576-850234a127c1', '0e41b234-53d3-4dcc-ad2d-ddd114b37346', 'f1ed73ce-2747-42ff-bd88-fa69a7e2a21d'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:24.654915 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-fbec782e-71cf-4b21-a741-fd9596e2d4b6 tempest-VolumesExtendTest-36044883 None] Delete snapshot completed successfully. Jun 04 21:18:24.659971 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-fbec782e-71cf-4b21-a741-fd9596e2d4b6 tempest-VolumesExtendTest-36044883 None] Lock "b'cinder-fe8b3de4-0684-4619-8e02-6c72590badbe-delete_snapshot'" released by "delete_snapshot" :: held 0.764s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:25.024199 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c059643f-cd01-4db2-8ffc-9fb4634ba699 tempest-VolumesExtendTest-36044883 None] Lock "b'cinder-7e05663b-1774-4a58-8f86-1b6bf4967511-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:25.091591 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c059643f-cd01-4db2-8ffc-9fb4634ba699 tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:25.140031 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c059643f-cd01-4db2-8ffc-9fb4634ba699 tempest-VolumesExtendTest-36044883 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:18:25.141065 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c059643f-cd01-4db2-8ffc-9fb4634ba699 tempest-VolumesExtendTest-36044883 None] Volume volume-7e05663b-1774-4a58-8f86-1b6bf4967511 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:18:25.149757 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c059643f-cd01-4db2-8ffc-9fb4634ba699 tempest-VolumesExtendTest-36044883 None] deleting rbd volume volume-7e05663b-1774-4a58-8f86-1b6bf4967511 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:18:25.388918 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=62,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:25.410417 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-c059643f-cd01-4db2-8ffc-9fb4634ba699 tempest-VolumesExtendTest-36044883 None] Created reservations ['473ffedc-7b0f-4a08-9ddb-95521b2c7de0', '69c03c2a-d8b8-4483-8a7d-b138c8021b0d', '2e33229e-1e5a-41a3-b600-6a45d95ce997', '66efe398-87f4-4bda-a4d8-4a93ea086fd9'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:25.455006 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=63,cinder:UPDATE=24,cinder:INSERT=13 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:25.462066 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c059643f-cd01-4db2-8ffc-9fb4634ba699 tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:25.496248 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c059643f-cd01-4db2-8ffc-9fb4634ba699 tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:25.533266 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-c059643f-cd01-4db2-8ffc-9fb4634ba699 tempest-VolumesExtendTest-36044883 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:18:25.538137 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c059643f-cd01-4db2-8ffc-9fb4634ba699 tempest-VolumesExtendTest-36044883 None] Deleted volume successfully. Jun 04 21:18:25.552937 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c059643f-cd01-4db2-8ffc-9fb4634ba699 tempest-VolumesExtendTest-36044883 None] Lock "b'cinder-7e05663b-1774-4a58-8f86-1b6bf4967511-delete_volume'" released by "delete_volume" :: held 0.529s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:26.189514 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] Lock "b'cinder-b2bc8d44-ba64-4b9b-8f8f-a5c802d04173-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:26.265013 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:26.338243 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:18:26.345954 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] deleting rbd volume volume-b2bc8d44-ba64-4b9b-8f8f-a5c802d04173 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:18:26.646964 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:18:26.688003 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] deleting parent snapshot volume-b2bc8d44-ba64-4b9b-8f8f-a5c802d04173.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:18:27.614670 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-3953f863-1808-4c3e-a09a-040a3fac35e0 req-5e5bf88b-9127-4530-95a5-faac61aa3710 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:27.726156 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] Created reservations ['c0a86a88-1881-4e98-8447-b4cf349760d2', '2e4499b4-2718-44e8-bbd5-72369115781d', '84099c45-5bd6-4f06-bea7-4e53474e2154', '1dcc9370-eb79-4cd7-be71-45209ed824b9'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:27.781240 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:27.810335 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:27.850427 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:18:27.856118 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] Deleted volume successfully. Jun 04 21:18:27.872402 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-7a7183dc-7273-4588-8b27-e1e06644983a tempest-VolumesExtendTest-36044883 None] Lock "b'cinder-b2bc8d44-ba64-4b9b-8f8f-a5c802d04173-delete_volume'" released by "delete_volume" :: held 1.683s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:28.640342 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-3953f863-1808-4c3e-a09a-040a3fac35e0 req-5e5bf88b-9127-4530-95a5-faac61aa3710 tempest-TestVolumeBootPattern-524389578 None] Create snapshot completed successfully Jun 04 21:18:29.568466 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:18:29.590102 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Flow 'volume_create_manager' (408b228e-d551-41e6-8591-127b0064ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:29.596517 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e754d17f-eb4a-42ef-8aee-69d63c32d918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:29.632139 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e754d17f-eb4a-42ef-8aee-69d63c32d918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-220472246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=107ae096-ea35-42c9-ad18-2b1696f2a64e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87608a2ca91846cab148c802519d40b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:18:30Z,use_quota=True,user_id='d96cade4cead4edeb39f14ad902985d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:29.663118 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09c058e-ecc0-48eb-8190-c5eebab5d784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:29.667282 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09c058e-ecc0-48eb-8190-c5eebab5d784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:29.679160 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3c820f-52a7-47ce-9f8f-f3c2bd2c63c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:29.685065 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3c820f-52a7-47ce-9f8f-f3c2bd2c63c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107ae096-ea35-42c9-ad18-2b1696f2a64e', 'volume_name': 'volume-107ae096-ea35-42c9-ad18-2b1696f2a64e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:29.690236 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8647f81-2966-40c5-8e1a-4ab95c891a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:29.694601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8647f81-2966-40c5-8e1a-4ab95c891a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:29.699834 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7538b5f-46fc-4f77-a54b-be13ce191adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:29.701410 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Volume 107ae096-ea35-42c9-ad18-2b1696f2a64e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107ae096-ea35-42c9-ad18-2b1696f2a64e', 'volume_size': 1} Jun 04 21:18:29.702160 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] creating volume 'volume-107ae096-ea35-42c9-ad18-2b1696f2a64e' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:18:29.704240 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:29.786873 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:18:29.787648 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:18:29.792719 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7538b5f-46fc-4f77-a54b-be13ce191adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107ae096-ea35-42c9-ad18-2b1696f2a64e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:29.797249 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fad15b6-9460-491f-8b3d-e546773c288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:29.808051 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Volume volume-107ae096-ea35-42c9-ad18-2b1696f2a64e (107ae096-ea35-42c9-ad18-2b1696f2a64e): created successfully Jun 04 21:18:29.812276 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fad15b6-9460-491f-8b3d-e546773c288d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:29.817811 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Flow 'volume_create_manager' (408b228e-d551-41e6-8591-127b0064ffed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:29.829244 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 req-c3c43a71-6281-4bd4-8405-c22b141e31eb tempest-VolumesGetTestJSON-1692901552 None] Created volume successfully. Jun 04 21:18:30.954411 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:18:30.974044 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Flow 'volume_create_manager' (269c91f9-68c4-44a6-b881-e4d71523ffbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:30.980497 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c666ef4-4663-4c60-99c9-ca179ffe7462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:30.999795 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c666ef4-4663-4c60-99c9-ca179ffe7462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1584644241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=02faf317-eb15-4d6f-8635-6e5416b611f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278f1e89f4784523999f8c3aa0017dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:18:31Z,use_quota=True,user_id='dda14bb28a0c46928de7f87c58cb942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:31.005005 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7a7ec1-c332-4f54-962a-84eea1c7885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:31.009031 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7a7ec1-c332-4f54-962a-84eea1c7885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:31.013933 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a67932c-7601-4cb2-b6b8-e121f893948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:31.018221 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a67932c-7601-4cb2-b6b8-e121f893948e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02faf317-eb15-4d6f-8635-6e5416b611f4', 'volume_name': 'volume-02faf317-eb15-4d6f-8635-6e5416b611f4', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:31.022907 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88673de-5fa0-4df0-9b07-9489e2d69f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:31.026713 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88673de-5fa0-4df0-9b07-9489e2d69f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:31.031168 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a5d9ee-81a8-48da-beef-887e7d19d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:31.032281 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Volume 02faf317-eb15-4d6f-8635-6e5416b611f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02faf317-eb15-4d6f-8635-6e5416b611f4', 'volume_size': 1} Jun 04 21:18:31.032670 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] creating volume 'volume-02faf317-eb15-4d6f-8635-6e5416b611f4' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:18:31.033315 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:31.095066 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 req-6e56d80c-5503-4dbe-882e-fabf61fce8e5 tempest-VolumesGetTestJSON-1692901552 None] Lock "b'cinder-107ae096-ea35-42c9-ad18-2b1696f2a64e-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:31.152316 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:18:31.153103 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:18:31.157470 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a5d9ee-81a8-48da-beef-887e7d19d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02faf317-eb15-4d6f-8635-6e5416b611f4', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:31.162090 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb58ca6-c978-479a-a235-1860f936a02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:31.170290 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 req-6e56d80c-5503-4dbe-882e-fabf61fce8e5 tempest-VolumesGetTestJSON-1692901552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:31.246946 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 req-6e56d80c-5503-4dbe-882e-fabf61fce8e5 tempest-VolumesGetTestJSON-1692901552 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:18:31.247376 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 req-6e56d80c-5503-4dbe-882e-fabf61fce8e5 tempest-VolumesGetTestJSON-1692901552 None] Volume volume-107ae096-ea35-42c9-ad18-2b1696f2a64e is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:18:31.258730 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 req-6e56d80c-5503-4dbe-882e-fabf61fce8e5 tempest-VolumesGetTestJSON-1692901552 None] deleting rbd volume volume-107ae096-ea35-42c9-ad18-2b1696f2a64e {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:18:31.263559 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Volume volume-02faf317-eb15-4d6f-8635-6e5416b611f4 (02faf317-eb15-4d6f-8635-6e5416b611f4): created successfully Jun 04 21:18:31.268340 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb58ca6-c978-479a-a235-1860f936a02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:31.274417 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Flow 'volume_create_manager' (269c91f9-68c4-44a6-b881-e4d71523ffbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:31.293822 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-39625a5a-7b59-48ec-baf0-49e1d2548b7b tempest-VolumesSnapshotListTestJSON-111162874 None] Created volume successfully. Jun 04 21:18:31.684133 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 req-6e56d80c-5503-4dbe-882e-fabf61fce8e5 tempest-VolumesGetTestJSON-1692901552 None] Created reservations ['ba03cbcf-9559-4d58-af1d-df4dfe8bb0f2', '75aa8155-cafb-4e13-b3df-ae8f616a43e0', '232bf837-a638-4df1-a7d9-588ff24dd064', 'f5b922d3-3806-4e0d-853b-55d55166f006'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:31.755773 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 req-6e56d80c-5503-4dbe-882e-fabf61fce8e5 tempest-VolumesGetTestJSON-1692901552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:31.815025 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 req-6e56d80c-5503-4dbe-882e-fabf61fce8e5 tempest-VolumesGetTestJSON-1692901552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:31.858340 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 req-6e56d80c-5503-4dbe-882e-fabf61fce8e5 tempest-VolumesGetTestJSON-1692901552 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:18:31.863443 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 req-6e56d80c-5503-4dbe-882e-fabf61fce8e5 tempest-VolumesGetTestJSON-1692901552 None] Deleted volume successfully. Jun 04 21:18:31.881234 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 req-6e56d80c-5503-4dbe-882e-fabf61fce8e5 tempest-VolumesGetTestJSON-1692901552 None] Lock "b'cinder-107ae096-ea35-42c9-ad18-2b1696f2a64e-delete_volume'" released by "delete_volume" :: held 0.786s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:31.937873 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:18:32.001521 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (798b18a7-1d00-47c3-a0a7-8cbbde91dcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:32.014258 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cac5fe8-689f-4b1f-be14-7924984416fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:32.058870 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cac5fe8-689f-4b1f-be14-7924984416fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:18:32Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=04399b8c-d20d-4de1-a2a2-6eeafd019f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6af5f33fb64a17906872b7edb1e049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67af8623-01a7-4b50-8986-81991195999d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:18:32Z,use_quota=True,user_id='2356361a22724a45a9213f5b1b4b71fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:32.070221 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca969a5d-caa0-41cc-99b8-090e89293133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:32.074742 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca969a5d-caa0-41cc-99b8-090e89293133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:32.081557 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7094128e-4ed6-429f-9c7e-d6e5f46586b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:32.086023 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7094128e-4ed6-429f-9c7e-d6e5f46586b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '04399b8c-d20d-4de1-a2a2-6eeafd019f37', 'volume_name': 'volume-04399b8c-d20d-4de1-a2a2-6eeafd019f37', 'volume_size': 1, 'snapshot_id': '67af8623-01a7-4b50-8986-81991195999d'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:32.092024 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c85e3c3-5204-43d9-8a3b-430428352554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:32.096896 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c85e3c3-5204-43d9-8a3b-430428352554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:32.102789 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b16541-0795-48f7-bd8c-8885e2cb8160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:32.106080 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Volume 04399b8c-d20d-4de1-a2a2-6eeafd019f37: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-04399b8c-d20d-4de1-a2a2-6eeafd019f37', 'volume_size': 1, 'snapshot_id': '67af8623-01a7-4b50-8986-81991195999d'} Jun 04 21:18:32.180464 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] cloning volumes/volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba@snapshot-67af8623-01a7-4b50-8986-81991195999d to volume-04399b8c-d20d-4de1-a2a2-6eeafd019f37 {{(pid=130490) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} Jun 04 21:18:32.182339 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:32.315273 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:32.418927 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4047b0b6-1cb6-46d1-892d-86957e122665 tempest-VolumesSnapshotListTestJSON-111162874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:32.577253 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:18:32.578169 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:18:32.610417 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Marking volume 04399b8c-d20d-4de1-a2a2-6eeafd019f37 as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:18:32.623744 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Copying metadata from snapshot 67af8623-01a7-4b50-8986-81991195999d to 04399b8c-d20d-4de1-a2a2-6eeafd019f37. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jun 04 21:18:32.640889 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=28,cinder:SELECT=63,cinder:DELETE=4,cinder:INSERT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:32.692224 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b16541-0795-48f7-bd8c-8885e2cb8160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04399b8c-d20d-4de1-a2a2-6eeafd019f37', 'volume_size': 1, 'snapshot_id': '67af8623-01a7-4b50-8986-81991195999d'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:32.697609 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fa6e5d-798e-4207-8861-1f36a2dabf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:18:32.715076 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=46,cinder:UPDATE=25,cinder:INSERT=27,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:32.727394 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Volume volume-04399b8c-d20d-4de1-a2a2-6eeafd019f37 (04399b8c-d20d-4de1-a2a2-6eeafd019f37): created successfully Jun 04 21:18:32.731273 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fa6e5d-798e-4207-8861-1f36a2dabf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:18:32.738390 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (798b18a7-1d00-47c3-a0a7-8cbbde91dcd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:18:32.763574 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-94f47b0f-9b50-4128-9d1f-f0f7d2ec23aa tempest-TestVolumeBootPattern-524389578 None] Created volume successfully. Jun 04 21:18:33.568714 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4047b0b6-1cb6-46d1-892d-86957e122665 tempest-VolumesSnapshotListTestJSON-111162874 None] Create snapshot completed successfully Jun 04 21:18:34.648678 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-67e78b40-d846-4685-b5ef-cb7a473d7dcf tempest-VolumesSnapshotListTestJSON-111162874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:35.291536 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-8b8405a6-fde8-401d-a738-158a67687209 req-96de28f2-c53d-40d1-a3ed-b76ede49c0ec tempest-TestVolumeBootPattern-524389578 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:18:35.606521 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-67e78b40-d846-4685-b5ef-cb7a473d7dcf tempest-VolumesSnapshotListTestJSON-111162874 None] Create snapshot completed successfully Jun 04 21:18:35.915556 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-457c33df-4098-4263-a6c1-8aa115dcbd5e tempest-VolumesSnapshotListTestJSON-111162874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:36.097589 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-8b8405a6-fde8-401d-a738-158a67687209 req-96de28f2-c53d-40d1-a3ed-b76ede49c0ec tempest-TestVolumeBootPattern-524389578 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.806s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:18:36.098680 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-8b8405a6-fde8-401d-a738-158a67687209 req-96de28f2-c53d-40d1-a3ed-b76ede49c0ec tempest-TestVolumeBootPattern-524389578 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-04399b8c-d20d-4de1-a2a2-6eeafd019f37', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '04399b8c-d20d-4de1-a2a2-6eeafd019f37', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:18:36.121421 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-96de28f2-c53d-40d1-a3ed-b76ede49c0ec tempest-TestVolumeBootPattern-524389578 None] Connection info returned from driver {'name': 'volumes/volume-04399b8c-d20d-4de1-a2a2-6eeafd019f37', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '04399b8c-d20d-4de1-a2a2-6eeafd019f37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dcff93d7-8e29-477c-b809-e193ee06d46c'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:18:36.189526 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-8b8405a6-fde8-401d-a738-158a67687209 req-96de28f2-c53d-40d1-a3ed-b76ede49c0ec tempest-TestVolumeBootPattern-524389578 None] attachment_update completed successfully. Jun 04 21:18:36.538698 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-457c33df-4098-4263-a6c1-8aa115dcbd5e tempest-VolumesSnapshotListTestJSON-111162874 None] Create snapshot completed successfully Jun 04 21:18:37.752510 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f79145b6-676c-4197-8356-1a746329461b tempest-VolumesSnapshotListTestJSON-111162874 None] Lock "b'cinder-8bdec201-c564-4071-9826-8ce55e57e84c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:37.754077 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f79145b6-676c-4197-8356-1a746329461b tempest-VolumesSnapshotListTestJSON-111162874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:38.694148 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-f79145b6-676c-4197-8356-1a746329461b tempest-VolumesSnapshotListTestJSON-111162874 None] Created reservations ['6faeb301-879f-41ce-8c47-20f6f9348c4d', '79188abd-0371-45eb-bb8a-51f94a420c87', '67f2a3aa-dc2c-4bb9-bbcd-c9c74d0fe87f', '7e6adee9-a08f-4727-9829-bd3a37a50a91'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:38.733230 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f79145b6-676c-4197-8356-1a746329461b tempest-VolumesSnapshotListTestJSON-111162874 None] Delete snapshot completed successfully. Jun 04 21:18:38.739753 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f79145b6-676c-4197-8356-1a746329461b tempest-VolumesSnapshotListTestJSON-111162874 None] Lock "b'cinder-8bdec201-c564-4071-9826-8ce55e57e84c-delete_snapshot'" released by "delete_snapshot" :: held 0.987s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:38.861855 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-992dd25d-ae60-47a1-8d6e-6e2b539fc25a tempest-VolumesSnapshotListTestJSON-111162874 None] Lock "b'cinder-2914aa1e-d940-46ca-9ade-5e6b8d257003-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:38.864550 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-992dd25d-ae60-47a1-8d6e-6e2b539fc25a tempest-VolumesSnapshotListTestJSON-111162874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:39.695198 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-992dd25d-ae60-47a1-8d6e-6e2b539fc25a tempest-VolumesSnapshotListTestJSON-111162874 None] Created reservations ['ec078772-1009-4141-8325-c5d351910f49', '1b154853-5fc9-4186-ab54-570ae5ce053c', '2c9df0f0-8168-4b83-aa50-b5c95eab46dc', '8c3ab505-bc02-4c75-a9c3-a6ce0b3231ab'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:39.737444 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-992dd25d-ae60-47a1-8d6e-6e2b539fc25a tempest-VolumesSnapshotListTestJSON-111162874 None] Delete snapshot completed successfully. Jun 04 21:18:39.743499 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-992dd25d-ae60-47a1-8d6e-6e2b539fc25a tempest-VolumesSnapshotListTestJSON-111162874 None] Lock "b'cinder-2914aa1e-d940-46ca-9ade-5e6b8d257003-delete_snapshot'" released by "delete_snapshot" :: held 0.882s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:39.967318 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f7249486-5fe5-4cf6-a8b9-9624d0c7db15 tempest-VolumesSnapshotListTestJSON-111162874 None] Lock "b'cinder-eb114abf-8e43-4483-9da2-4fe5a31719c4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:39.970226 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f7249486-5fe5-4cf6-a8b9-9624d0c7db15 tempest-VolumesSnapshotListTestJSON-111162874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:40.729888 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-f7249486-5fe5-4cf6-a8b9-9624d0c7db15 tempest-VolumesSnapshotListTestJSON-111162874 None] Created reservations ['a0038b7e-e7c8-479e-a91c-d04717c8955c', '0351fc32-2795-4bba-b01c-a89341ee1206', '5e57e723-5fce-42d8-a628-96bcd2cf6e0b', 'b6c82c3f-8909-459a-bd42-b5e16a8f67c1'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:40.769123 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f7249486-5fe5-4cf6-a8b9-9624d0c7db15 tempest-VolumesSnapshotListTestJSON-111162874 None] Delete snapshot completed successfully. Jun 04 21:18:40.774035 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f7249486-5fe5-4cf6-a8b9-9624d0c7db15 tempest-VolumesSnapshotListTestJSON-111162874 None] Lock "b'cinder-eb114abf-8e43-4483-9da2-4fe5a31719c4-delete_snapshot'" released by "delete_snapshot" :: held 0.807s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:41.110306 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-1cc8b614-3705-4192-9f73-2446e6c2867a tempest-VolumesSnapshotListTestJSON-111162874 None] Lock "b'cinder-02faf317-eb15-4d6f-8635-6e5416b611f4-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:41.146461 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1cc8b614-3705-4192-9f73-2446e6c2867a tempest-VolumesSnapshotListTestJSON-111162874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:41.188342 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1cc8b614-3705-4192-9f73-2446e6c2867a tempest-VolumesSnapshotListTestJSON-111162874 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:18:41.188795 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1cc8b614-3705-4192-9f73-2446e6c2867a tempest-VolumesSnapshotListTestJSON-111162874 None] Volume volume-02faf317-eb15-4d6f-8635-6e5416b611f4 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:18:41.196068 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1cc8b614-3705-4192-9f73-2446e6c2867a tempest-VolumesSnapshotListTestJSON-111162874 None] deleting rbd volume volume-02faf317-eb15-4d6f-8635-6e5416b611f4 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:18:41.479431 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-1cc8b614-3705-4192-9f73-2446e6c2867a tempest-VolumesSnapshotListTestJSON-111162874 None] Created reservations ['1a49f028-c7e9-4801-9e8c-217c71d766a6', 'f6216493-fc40-4ec9-b9c4-fa8146230764', '968dddcb-92a2-48b2-9b79-2a8bed5576eb', 'fdfd42db-8d9c-4f38-81a4-0036c8d45354'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:41.520857 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=67,cinder:UPDATE=23,cinder:DELETE=1,cinder:INSERT=9 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:41.525660 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=58,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=7 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:41.539665 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1cc8b614-3705-4192-9f73-2446e6c2867a tempest-VolumesSnapshotListTestJSON-111162874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:41.578055 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1cc8b614-3705-4192-9f73-2446e6c2867a tempest-VolumesSnapshotListTestJSON-111162874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:41.634361 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-1cc8b614-3705-4192-9f73-2446e6c2867a tempest-VolumesSnapshotListTestJSON-111162874 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:18:41.639478 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1cc8b614-3705-4192-9f73-2446e6c2867a tempest-VolumesSnapshotListTestJSON-111162874 None] Deleted volume successfully. Jun 04 21:18:41.657393 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-1cc8b614-3705-4192-9f73-2446e6c2867a tempest-VolumesSnapshotListTestJSON-111162874 None] Lock "b'cinder-02faf317-eb15-4d6f-8635-6e5416b611f4-delete_volume'" released by "delete_volume" :: held 0.547s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:45.394162 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-f01da798-d629-420d-802e-5fdb555475f3 tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['52c0b5ed-e20e-4c50-ac19-bb9c809286a0', 'd6726501-94e7-4101-9026-48e98d1ff2c2', 'a28a879f-7af7-4252-b7cc-2704c2958413', '3acfa0d6-7ef5-41c3-9af9-85fd7748c4c7'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:45.447912 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f01da798-d629-420d-802e-5fdb555475f3 tempest-VolumesSnapshotTestJSON-1648955989 None] Delete snapshot completed successfully. Jun 04 21:18:45.456175 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f01da798-d629-420d-802e-5fdb555475f3 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-1970e5d6-921e-4859-ae7d-2926328b6f31-delete_snapshot'" released by "delete_snapshot" :: held 30.336s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:46.054856 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:18:46.056562 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:46.104564 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:46.170639 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:18:46.424429 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-1e9e7f0d-eb70-4194-9a90-79b19d98504e tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-bb18975f-88e4-4918-92f3-0d3601fbbcfd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.024s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:46.426650 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1e9e7f0d-eb70-4194-9a90-79b19d98504e tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:48.918999 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-1298d411-00f6-4699-9837-d2e87411c175 tempest-TestVolumeBootPattern-524389578 None] Terminate volume connection completed successfully. Jun 04 21:18:48.919682 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-1298d411-00f6-4699-9837-d2e87411c175 tempest-TestVolumeBootPattern-524389578 None] Deleting attachment dcff93d7-8e29-477c-b809-e193ee06d46c. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:18:49.224124 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-07420655-67dd-47d4-803d-6507fa0c4ab9 tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-04399b8c-d20d-4de1-a2a2-6eeafd019f37-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:49.324803 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-07420655-67dd-47d4-803d-6507fa0c4ab9 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:49.463761 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-07420655-67dd-47d4-803d-6507fa0c4ab9 tempest-TestVolumeBootPattern-524389578 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:18:49.474070 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-07420655-67dd-47d4-803d-6507fa0c4ab9 tempest-TestVolumeBootPattern-524389578 None] deleting rbd volume volume-04399b8c-d20d-4de1-a2a2-6eeafd019f37 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:18:49.915433 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-59274173-c837-403a-ab01-1b90270f0df7 req-7eee25b5-f423-4c9c-a2d8-a449320bc3f8 tempest-AttachVolumeShelveTestJSON-1155730873 None] Terminate volume connection completed successfully. Jun 04 21:18:49.915992 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-59274173-c837-403a-ab01-1b90270f0df7 req-7eee25b5-f423-4c9c-a2d8-a449320bc3f8 tempest-AttachVolumeShelveTestJSON-1155730873 None] Deleting attachment cf0b830b-736d-4b7e-a538-3403ecada53a. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:18:49.919638 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-07420655-67dd-47d4-803d-6507fa0c4ab9 tempest-TestVolumeBootPattern-524389578 None] Created reservations ['3904440d-5e76-4e05-8c24-f115efa2ec1d', '05a8ebc9-5f66-4e96-ab32-114725160f2c', '1fe58405-6fb9-4d18-afda-ce5a4ef46aaa', 'e621d8ee-e857-4a51-85cf-698eded18f30'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:18:50.014648 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-07420655-67dd-47d4-803d-6507fa0c4ab9 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:50.079627 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-07420655-67dd-47d4-803d-6507fa0c4ab9 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:18:50.128165 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-07420655-67dd-47d4-803d-6507fa0c4ab9 tempest-TestVolumeBootPattern-524389578 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:18:50.134170 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-07420655-67dd-47d4-803d-6507fa0c4ab9 tempest-TestVolumeBootPattern-524389578 None] Deleted volume successfully. Jun 04 21:18:50.152830 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-fa139502-be0f-48e0-876b-4d1c82d192b3 req-07420655-67dd-47d4-803d-6507fa0c4ab9 tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-04399b8c-d20d-4de1-a2a2-6eeafd019f37-delete_volume'" released by "delete_volume" :: held 0.930s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:18:50.477725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2b54cd95-9005-4b80-8fd4-91d3216bd78f tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-67af8623-01a7-4b50-8986-81991195999d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:18:50.481310 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2b54cd95-9005-4b80-8fd4-91d3216bd78f tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:00.140546 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=29,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:15.062545 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=20,cinder:SELECT=31,cinder:DELETE=1,cinder:INSERT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:16.708838 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-1e9e7f0d-eb70-4194-9a90-79b19d98504e tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['8c360898-cca4-4322-89ad-7589fbe697b8', 'df7244ae-bb75-46dc-9d62-6ea950026f00', 'c7d68680-37ac-4bc2-9130-81d8c80d7797', 'd06f6085-e3ed-4a91-b8af-6fa6616c39b6'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:19:16.756104 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1e9e7f0d-eb70-4194-9a90-79b19d98504e tempest-VolumesSnapshotTestJSON-1648955989 None] Delete snapshot completed successfully. Jun 04 21:19:16.761926 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-1e9e7f0d-eb70-4194-9a90-79b19d98504e tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-bb18975f-88e4-4918-92f3-0d3601fbbcfd-delete_snapshot'" released by "delete_snapshot" :: held 30.338s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:19:19.515094 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-a23320e1-c2f2-4750-ab55-dd736cdd737a req-4daaff2d-71a2-41b2-8d5f-331e2ece9e17 tempest-VolumesSnapshotTestJSON-1648955989 None] Terminate volume connection completed successfully. Jun 04 21:19:19.516286 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-a23320e1-c2f2-4750-ab55-dd736cdd737a req-4daaff2d-71a2-41b2-8d5f-331e2ece9e17 tempest-VolumesSnapshotTestJSON-1648955989 None] Deleting attachment 73381fec-2827-4795-a2f5-c7c94a5deb68. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:19:20.761724 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-2b54cd95-9005-4b80-8fd4-91d3216bd78f tempest-TestVolumeBootPattern-524389578 None] Created reservations ['80f910dd-3576-485f-a32a-3e0ff2c25910', 'f2f13b9f-8299-490b-82c7-d8b6d8606f76', '8925c314-aec1-4889-9b90-7c7217d1d283', '59756c61-a7a4-450c-a44a-84a2a2fb322f'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:19:20.840049 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2b54cd95-9005-4b80-8fd4-91d3216bd78f tempest-TestVolumeBootPattern-524389578 None] Delete snapshot completed successfully. Jun 04 21:19:20.852601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2b54cd95-9005-4b80-8fd4-91d3216bd78f tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-67af8623-01a7-4b50-8986-81991195999d-delete_snapshot'" released by "delete_snapshot" :: held 30.375s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:19:25.125022 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-aaea927c-5416-41c3-95d9-1f183f8ddf5c tempest-TestVolumeBootPattern-524389578 None] Terminate volume connection completed successfully. Jun 04 21:19:25.125669 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-aaea927c-5416-41c3-95d9-1f183f8ddf5c tempest-TestVolumeBootPattern-524389578 None] Deleting attachment 465a6388-f413-4cf0-b67a-af84a3ae8cdc. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:19:25.278939 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-a03e5283-6e7a-4d35-ba39-48cc091eeeba-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:19:25.315978 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:25.428306 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:19:25.442997 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] deleting rbd volume volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:19:25.712638 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:19:25.749467 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] deleting parent snapshot volume-a03e5283-6e7a-4d35-ba39-48cc091eeeba.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:19:26.684414 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-07418bf8-bad2-4601-9066-be38cef84ecf tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:26.751034 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] Created reservations ['80794fdc-f880-4251-b69f-2b6d599c7a2d', '2c6dcd6b-5548-46c2-9f64-95464bba198b', 'ad6a5d39-7e9a-4ead-b6f6-5b2e8c2d72a6', '62e35fa0-f10e-4d09-b46f-73f94ab4c0e7'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:19:26.798629 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:26.822992 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:26.846657 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:19:26.854538 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] Deleted volume successfully. Jun 04 21:19:26.863810 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 req-11ce3bec-b9e3-4010-8e81-9b908be7ab4d tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-a03e5283-6e7a-4d35-ba39-48cc091eeeba-delete_volume'" released by "delete_volume" :: held 1.585s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:19:27.746276 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-07418bf8-bad2-4601-9066-be38cef84ecf tempest-VolumesSnapshotTestJSON-1648955989 None] Create snapshot completed successfully Jun 04 21:19:28.655731 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f015f062-2957-480f-b769-175ce23f8f6c tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-37172407-c130-4560-9335-91123f4208ab-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:19:28.660725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f015f062-2957-480f-b769-175ce23f8f6c tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:29.902495 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-f015f062-2957-480f-b769-175ce23f8f6c tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['e2a270e4-f5fc-43ed-aeee-7db448bfb04d', '4ced1f72-9c37-45e1-b664-4ecd7ed092fa', '2aa69d61-4596-4db1-a69a-7e75eb105b2b', 'd58ffebf-a5a0-4e20-81a3-9bc12359ed9c'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:19:29.959388 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=61,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:29.973734 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f015f062-2957-480f-b769-175ce23f8f6c tempest-VolumesSnapshotTestJSON-1648955989 None] Delete snapshot completed successfully. Jun 04 21:19:29.979744 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f015f062-2957-480f-b769-175ce23f8f6c tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-37172407-c130-4560-9335-91123f4208ab-delete_snapshot'" released by "delete_snapshot" :: held 1.324s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:19:30.483613 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:19:30.506200 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (8ea8c27f-c691-45b8-ba90-8bf79fab1cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:19:30.512578 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9c2d98-72ff-474a-b8c0-f14b513f2b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:30.530598 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9c2d98-72ff-474a-b8c0-f14b513f2b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1857614607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6121e434-b2b6-4783-9a4b-90d85dc648ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6af5f33fb64a17906872b7edb1e049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:19:30Z,use_quota=True,user_id='2356361a22724a45a9213f5b1b4b71fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:30.537079 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f0c824-3640-4102-ae7f-64a04f2e7b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:30.541121 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f0c824-3640-4102-ae7f-64a04f2e7b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:30.545956 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50982d44-7670-41ce-92b6-c10491ae43ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:30.642377 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50982d44-7670-41ce-92b6-c10491ae43ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6121e434-b2b6-4783-9a4b-90d85dc648ef', 'volume_name': 'volume-6121e434-b2b6-4783-9a4b-90d85dc648ef', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:30.647132 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7aa55f-0597-4455-9e8f-e52416e3f46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:30.651903 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7aa55f-0597-4455-9e8f-e52416e3f46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:30.657201 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddf111b-4f59-43b3-a1f9-9ef7d7ee2900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:30.658622 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Volume 6121e434-b2b6-4783-9a4b-90d85dc648ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6121e434-b2b6-4783-9a4b-90d85dc648ef', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:19:30.659197 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Cloning 6121e434-b2b6-4783-9a4b-90d85dc648ef from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:19:30.674775 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:19:30.685875 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 19, 30, 679801)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:19:30.686494 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:19:30.687028 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:19:30.693883 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.019s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:19:30.694870 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:19:30.701032 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 19, 30, 698596)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:19:30.701430 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:19:30.701807 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:19:30.714161 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:30.793042 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] creating snapshot='volume-6121e434-b2b6-4783-9a4b-90d85dc648ef.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:19:31.528022 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-6121e434-b2b6-4783-9a4b-90d85dc648ef.clone_snap' to 'volume-6121e434-b2b6-4783-9a4b-90d85dc648ef' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:19:31.577152 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-599d9def-bc60-4eb8-a44b-cb89ac07ee4a tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:31.690058 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:19:31.691087 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:19:31.691460 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:19:31.708325 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:19:31.708954 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Marking volume 6121e434-b2b6-4783-9a4b-90d85dc648ef as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:19:31.718496 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 6121e434-b2b6-4783-9a4b-90d85dc648ef. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:19:31.718916 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Creating volume glance metadata for volume 6121e434-b2b6-4783-9a4b-90d85dc648ef backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:19:31.770984 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddf111b-4f59-43b3-a1f9-9ef7d7ee2900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6121e434-b2b6-4783-9a4b-90d85dc648ef', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:31.775721 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12058de3-a7fc-4370-9234-3a9a08f4175f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:31.786547 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Volume volume-6121e434-b2b6-4783-9a4b-90d85dc648ef (6121e434-b2b6-4783-9a4b-90d85dc648ef): created successfully Jun 04 21:19:31.790414 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12058de3-a7fc-4370-9234-3a9a08f4175f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:31.796145 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (8ea8c27f-c691-45b8-ba90-8bf79fab1cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:19:31.800084 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=56,cinder:INSERT=18,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:31.806415 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e5de241d-5b0f-4c5d-90f5-383451e81992 tempest-TestVolumeBootPattern-524389578 None] Created volume successfully. Jun 04 21:19:32.585598 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-599d9def-bc60-4eb8-a44b-cb89ac07ee4a tempest-VolumesSnapshotTestJSON-1648955989 None] Create snapshot completed successfully Jun 04 21:19:35.810866 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-3e0210cf-8710-46c6-9bb7-21c140514668 req-d6ee5203-fa08-4d99-8ef7-8114508a0130 tempest-TestVolumeBootPattern-524389578 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:19:36.549851 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-3e0210cf-8710-46c6-9bb7-21c140514668 req-d6ee5203-fa08-4d99-8ef7-8114508a0130 tempest-TestVolumeBootPattern-524389578 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.739s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:19:36.551242 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-3e0210cf-8710-46c6-9bb7-21c140514668 req-d6ee5203-fa08-4d99-8ef7-8114508a0130 tempest-TestVolumeBootPattern-524389578 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6121e434-b2b6-4783-9a4b-90d85dc648ef', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '6121e434-b2b6-4783-9a4b-90d85dc648ef', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:19:36.585127 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3e0210cf-8710-46c6-9bb7-21c140514668 req-d6ee5203-fa08-4d99-8ef7-8114508a0130 tempest-TestVolumeBootPattern-524389578 None] Connection info returned from driver {'name': 'volumes/volume-6121e434-b2b6-4783-9a4b-90d85dc648ef', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6121e434-b2b6-4783-9a4b-90d85dc648ef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3325486d-f3d3-4408-9809-51d717bc3e84'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:19:36.646241 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-3e0210cf-8710-46c6-9bb7-21c140514668 req-d6ee5203-fa08-4d99-8ef7-8114508a0130 tempest-TestVolumeBootPattern-524389578 None] attachment_update completed successfully. Jun 04 21:19:45.426021 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-f48820f1-ab6f-49fd-a18c-537db3a83317 req-35c196d6-c120-4212-af03-20385a27e685 tempest-VolumesSnapshotTestJSON-1648955989 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:19:45.523032 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:19:45.551279 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Flow 'volume_create_manager' (ebc3ad17-9d4b-41e4-83f2-a10a6845a005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:19:45.558752 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fa8246-ba2c-47b1-9e6d-7ec134f150aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:45.577496 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fa8246-ba2c-47b1-9e6d-7ec134f150aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1777547509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d93e0037-2eec-4568-95c2-a8f0dc49d2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7752a37a5984bc99d2acfcc327fc14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:19:45Z,use_quota=True,user_id='bff665dac5de4530ab70f20ba2da386d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:45.582676 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab099656-4a51-4e22-aac0-6bf866b7a586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:45.586724 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab099656-4a51-4e22-aac0-6bf866b7a586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:45.592000 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98d08d0-00da-4f26-99de-77db00985455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:45.595937 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98d08d0-00da-4f26-99de-77db00985455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd93e0037-2eec-4568-95c2-a8f0dc49d2c9', 'volume_name': 'volume-d93e0037-2eec-4568-95c2-a8f0dc49d2c9', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:45.600650 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd28302-858b-4f67-ba4a-3053eb68ef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:45.604715 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd28302-858b-4f67-ba4a-3053eb68ef16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:45.609366 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f10e6b1-3011-4b74-a201-a59ba3d892d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:45.610578 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Volume d93e0037-2eec-4568-95c2-a8f0dc49d2c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d93e0037-2eec-4568-95c2-a8f0dc49d2c9', 'volume_size': 1} Jun 04 21:19:45.610993 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] creating volume 'volume-d93e0037-2eec-4568-95c2-a8f0dc49d2c9' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:19:45.612028 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:45.708352 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:19:45.708790 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:19:45.713151 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f10e6b1-3011-4b74-a201-a59ba3d892d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93e0037-2eec-4568-95c2-a8f0dc49d2c9', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:45.720986 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb2c8c34-29d3-4222-9ca3-4f0e462275fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:45.744358 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Volume volume-d93e0037-2eec-4568-95c2-a8f0dc49d2c9 (d93e0037-2eec-4568-95c2-a8f0dc49d2c9): created successfully Jun 04 21:19:45.747973 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb2c8c34-29d3-4222-9ca3-4f0e462275fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:45.754683 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Flow 'volume_create_manager' (ebc3ad17-9d4b-41e4-83f2-a10a6845a005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:19:45.768865 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2342142f-f110-46fd-9c89-2afc00dfc006 tempest-AttachVolumeShelveTestJSON-1155730873 None] Created volume successfully. Jun 04 21:19:46.064211 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:19:46.065027 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:46.102321 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:46.136013 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:19:46.145585 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-f48820f1-ab6f-49fd-a18c-537db3a83317 req-35c196d6-c120-4212-af03-20385a27e685 tempest-VolumesSnapshotTestJSON-1648955989 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.720s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:19:46.146188 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-f48820f1-ab6f-49fd-a18c-537db3a83317 req-35c196d6-c120-4212-af03-20385a27e685 tempest-VolumesSnapshotTestJSON-1648955989 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1cc49d5c-997d-437a-81e2-dc8b803becae', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '1cc49d5c-997d-437a-81e2-dc8b803becae', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:19:46.169806 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-f48820f1-ab6f-49fd-a18c-537db3a83317 req-35c196d6-c120-4212-af03-20385a27e685 tempest-VolumesSnapshotTestJSON-1648955989 None] Connection info returned from driver {'name': 'volumes/volume-1cc49d5c-997d-437a-81e2-dc8b803becae', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1cc49d5c-997d-437a-81e2-dc8b803becae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2cd3b868-820e-43f3-a341-94436386b34a'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:19:46.220123 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-f48820f1-ab6f-49fd-a18c-537db3a83317 req-35c196d6-c120-4212-af03-20385a27e685 tempest-VolumesSnapshotTestJSON-1648955989 None] attachment_update completed successfully. Jun 04 21:19:48.429532 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a834ae8b-9a03-472f-90e9-56429bb7b145 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:48.746271 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a834ae8b-9a03-472f-90e9-56429bb7b145 tempest-VolumesSnapshotTestJSON-1648955989 None] Create snapshot completed successfully Jun 04 21:19:49.714156 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-dd21d85d-83b5-44f3-9634-de4918f852d8 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:50.784075 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-dd21d85d-83b5-44f3-9634-de4918f852d8 tempest-VolumesSnapshotTestJSON-1648955989 None] Create snapshot completed successfully Jun 04 21:19:51.781500 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-360b0656-e8c2-40ff-b557-cf6d780c17fa tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-ed18a9a5-2a33-4715-a83f-c2a0883b8a46-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:19:51.782976 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-360b0656-e8c2-40ff-b557-cf6d780c17fa tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:58.511680 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:19:58.532548 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Flow 'volume_create_manager' (176d2f06-a18a-461f-84e2-dd4738497457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:19:58.539389 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aba562c-9ccc-4e75-ab1a-05f353f2c7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:58.556107 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aba562c-9ccc-4e75-ab1a-05f353f2c7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-559504699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e55940a4-eed0-4479-8bd9-00bf3d2dd587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed013dca03534a42a3a99593e56d0162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:19:58Z,use_quota=True,user_id='6343f086d9584796aba71988b14570f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:58.562507 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57052877-211b-4c76-8fc8-748438d41427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:58.567145 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57052877-211b-4c76-8fc8-748438d41427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:58.572809 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e91aba1-be66-4a4e-8240-9831c16c5a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:58.577398 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e91aba1-be66-4a4e-8240-9831c16c5a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e55940a4-eed0-4479-8bd9-00bf3d2dd587', 'volume_name': 'volume-e55940a4-eed0-4479-8bd9-00bf3d2dd587', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:58.582213 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32143c34-2ac5-417a-ab9d-0c0a757c04b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:58.586370 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32143c34-2ac5-417a-ab9d-0c0a757c04b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:58.591141 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc6ce92-64e5-44bc-bb10-e0d458d13e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:58.592215 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Volume e55940a4-eed0-4479-8bd9-00bf3d2dd587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e55940a4-eed0-4479-8bd9-00bf3d2dd587', 'volume_size': 1} Jun 04 21:19:58.592600 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] creating volume 'volume-e55940a4-eed0-4479-8bd9-00bf3d2dd587' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:19:58.593258 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:19:58.665794 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:19:58.666471 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:19:58.672786 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc6ce92-64e5-44bc-bb10-e0d458d13e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e55940a4-eed0-4479-8bd9-00bf3d2dd587', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:58.680630 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd09c7fe-ec62-4b57-b27b-fb507152a4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:19:58.694926 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Volume volume-e55940a4-eed0-4479-8bd9-00bf3d2dd587 (e55940a4-eed0-4479-8bd9-00bf3d2dd587): created successfully Jun 04 21:19:58.699847 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd09c7fe-ec62-4b57-b27b-fb507152a4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:19:58.705842 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Flow 'volume_create_manager' (176d2f06-a18a-461f-84e2-dd4738497457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:19:58.717357 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-71e0597d-380e-42fc-bff8-943a601041ef tempest-AttachVolumeNegativeTest-475698259 None] Created volume successfully. Jun 04 21:20:00.122186 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=68,cinder:UPDATE=13,cinder:INSERT=4,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:00.134695 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-383e9a80-c3ee-42c1-94f9-502cef254125 req-4bd6b71c-fda3-4246-b845-3b19f680223f tempest-AttachVolumeNegativeTest-475698259 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:20:00.827759 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-383e9a80-c3ee-42c1-94f9-502cef254125 req-4bd6b71c-fda3-4246-b845-3b19f680223f tempest-AttachVolumeNegativeTest-475698259 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.693s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:20:00.828594 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-383e9a80-c3ee-42c1-94f9-502cef254125 req-4bd6b71c-fda3-4246-b845-3b19f680223f tempest-AttachVolumeNegativeTest-475698259 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e55940a4-eed0-4479-8bd9-00bf3d2dd587', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'e55940a4-eed0-4479-8bd9-00bf3d2dd587', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:20:00.857699 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-383e9a80-c3ee-42c1-94f9-502cef254125 req-4bd6b71c-fda3-4246-b845-3b19f680223f tempest-AttachVolumeNegativeTest-475698259 None] Connection info returned from driver {'name': 'volumes/volume-e55940a4-eed0-4479-8bd9-00bf3d2dd587', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e55940a4-eed0-4479-8bd9-00bf3d2dd587', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '91125838-a52d-481f-bd8b-251a21697ef2'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:20:00.914782 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-383e9a80-c3ee-42c1-94f9-502cef254125 req-4bd6b71c-fda3-4246-b845-3b19f680223f tempest-AttachVolumeNegativeTest-475698259 None] attachment_update completed successfully. Jun 04 21:20:05.075476 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=56,cinder:DELETE=3,cinder:UPDATE=11 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:15.083229 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:22.013769 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-360b0656-e8c2-40ff-b557-cf6d780c17fa tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['20b60f34-9179-40c6-ad3d-40860aec346c', '26cddb0f-a2ff-4e1a-8fc9-7427e8da6e85', '69c0a9f8-ac6e-4266-8c59-52c2cdf2aeb9', 'f9dbef00-221b-4335-bea5-3547835aec02'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:20:22.103360 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-360b0656-e8c2-40ff-b557-cf6d780c17fa tempest-VolumesSnapshotTestJSON-1648955989 None] Delete snapshot completed successfully. Jun 04 21:20:22.122225 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-360b0656-e8c2-40ff-b557-cf6d780c17fa tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-ed18a9a5-2a33-4715-a83f-c2a0883b8a46-delete_snapshot'" released by "delete_snapshot" :: held 30.341s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:20:23.073206 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-6bbc444c-6a21-4b44-9253-39caecce1cce tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-68d0815f-6256-4051-bddc-d47596f9d367-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:20:23.077282 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6bbc444c-6a21-4b44-9253-39caecce1cce tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:20:26.043876 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-63a92bc3-a41b-4368-b561-4c7014bda7a3 req-0cc3acfd-f281-4912-b09f-86886c048e98 tempest-AttachVolumeShelveTestJSON-1155730873 None] No connector for attachment 6572b67f-aec2-4a4d-90b5-5fec3caf353e; skipping storage backend terminate_connection call. {{(pid=130490) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4914}} Jun 04 21:20:26.044585 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-63a92bc3-a41b-4368-b561-4c7014bda7a3 req-0cc3acfd-f281-4912-b09f-86886c048e98 tempest-AttachVolumeShelveTestJSON-1155730873 None] Deleting attachment 6572b67f-aec2-4a4d-90b5-5fec3caf353e. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:20:45.087141 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=16,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:46.064703 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:20:46.065600 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:20:46.200487 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:20:46.282709 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:20:53.246885 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=19,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:53.290300 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-6bbc444c-6a21-4b44-9253-39caecce1cce tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['da17ac95-77f2-414d-85d2-223f68f9d113', '210048f0-7257-440a-a66d-7b3bc130b12b', '5930d092-5163-4c2a-86b9-5a2b6ebc9272', '35677d28-e053-468e-999e-afa3cc604bd5'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:20:53.332498 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-6bbc444c-6a21-4b44-9253-39caecce1cce tempest-VolumesSnapshotTestJSON-1648955989 None] Delete snapshot completed successfully. Jun 04 21:20:53.339483 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-6bbc444c-6a21-4b44-9253-39caecce1cce tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-68d0815f-6256-4051-bddc-d47596f9d367-delete_snapshot'" released by "delete_snapshot" :: held 30.266s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:20:54.424538 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c373d614-2c88-49c3-a48c-826983017d91 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-31947c94-0084-4186-ac27-aa112c9b80fc-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.030s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:20:54.428207 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c373d614-2c88-49c3-a48c-826983017d91 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:02.952148 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-c1a6692a-32d0-450c-b10c-6aaf7eb5db14 req-cac7a155-8e94-4eb6-905e-4cf8874cfc83 tempest-AttachVolumeNegativeTest-475698259 None] Terminate volume connection completed successfully. Jun 04 21:21:02.952837 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-c1a6692a-32d0-450c-b10c-6aaf7eb5db14 req-cac7a155-8e94-4eb6-905e-4cf8874cfc83 tempest-AttachVolumeNegativeTest-475698259 None] Deleting attachment 91125838-a52d-481f-bd8b-251a21697ef2. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:21:15.080875 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:24.590714 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=21,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:24.638111 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-c373d614-2c88-49c3-a48c-826983017d91 tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['518f8362-93dd-44eb-951d-54ddc570f9c4', 'c5641412-65fd-43ae-8d12-35140e73a9f2', 'f6f3aa25-2021-4570-9a4a-0f6c73f7814a', '9ea06573-3786-4110-ac60-0205bdc8bdb8'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:24.714672 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c373d614-2c88-49c3-a48c-826983017d91 tempest-VolumesSnapshotTestJSON-1648955989 None] Delete snapshot completed successfully. Jun 04 21:21:24.724137 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c373d614-2c88-49c3-a48c-826983017d91 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-31947c94-0084-4186-ac27-aa112c9b80fc-delete_snapshot'" released by "delete_snapshot" :: held 30.301s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:26.468611 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-e97b8642-cdea-4429-b23d-486cca876b84 req-513ebf5b-5094-4813-84da-3ba45fbd8cef tempest-VolumesSnapshotTestJSON-1648955989 None] Terminate volume connection completed successfully. Jun 04 21:21:26.469227 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-e97b8642-cdea-4429-b23d-486cca876b84 req-513ebf5b-5094-4813-84da-3ba45fbd8cef tempest-VolumesSnapshotTestJSON-1648955989 None] Deleting attachment 2cd3b868-820e-43f3-a341-94436386b34a. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:21:28.062443 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0063e240-2dd7-49c7-8237-f390a6939947 tempest-AttachVolumeShelveTestJSON-1155730873 None] Lock "b'cinder-d93e0037-2eec-4568-95c2-a8f0dc49d2c9-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:21:28.109774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0063e240-2dd7-49c7-8237-f390a6939947 tempest-AttachVolumeShelveTestJSON-1155730873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:28.196539 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0063e240-2dd7-49c7-8237-f390a6939947 tempest-AttachVolumeShelveTestJSON-1155730873 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:21:28.197229 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0063e240-2dd7-49c7-8237-f390a6939947 tempest-AttachVolumeShelveTestJSON-1155730873 None] Volume volume-d93e0037-2eec-4568-95c2-a8f0dc49d2c9 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:21:28.208127 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0063e240-2dd7-49c7-8237-f390a6939947 tempest-AttachVolumeShelveTestJSON-1155730873 None] deleting rbd volume volume-d93e0037-2eec-4568-95c2-a8f0dc49d2c9 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:21:28.759941 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-0063e240-2dd7-49c7-8237-f390a6939947 tempest-AttachVolumeShelveTestJSON-1155730873 None] Created reservations ['37dce139-09e6-41ad-bee8-de98939998c6', '7de77cd4-d7ea-4009-a6f1-3ded44d5cafa', '0037bb4a-7768-49e5-b83f-ead0bae02cb0', 'a888dc3f-9c51-455f-b0a8-6b4e4589b75e'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:28.884455 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0063e240-2dd7-49c7-8237-f390a6939947 tempest-AttachVolumeShelveTestJSON-1155730873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:28.961605 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0063e240-2dd7-49c7-8237-f390a6939947 tempest-AttachVolumeShelveTestJSON-1155730873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:28.994702 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0063e240-2dd7-49c7-8237-f390a6939947 tempest-AttachVolumeShelveTestJSON-1155730873 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:21:29.005019 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0063e240-2dd7-49c7-8237-f390a6939947 tempest-AttachVolumeShelveTestJSON-1155730873 None] Deleted volume successfully. Jun 04 21:21:29.029629 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0063e240-2dd7-49c7-8237-f390a6939947 tempest-AttachVolumeShelveTestJSON-1155730873 None] Lock "b'cinder-d93e0037-2eec-4568-95c2-a8f0dc49d2c9-delete_volume'" released by "delete_volume" :: held 0.967s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:29.437972 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2ebd0b27-9582-4df9-afac-cc9994d56048 tempest-AttachVolumeShelveTestJSON-1155730873 None] Lock "b'cinder-f0af00c0-1332-46a0-b28a-878815945d12-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:21:29.540693 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2ebd0b27-9582-4df9-afac-cc9994d56048 tempest-AttachVolumeShelveTestJSON-1155730873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:29.616406 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2ebd0b27-9582-4df9-afac-cc9994d56048 tempest-AttachVolumeShelveTestJSON-1155730873 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:21:29.616406 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2ebd0b27-9582-4df9-afac-cc9994d56048 tempest-AttachVolumeShelveTestJSON-1155730873 None] Volume volume-f0af00c0-1332-46a0-b28a-878815945d12 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:21:29.635697 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2ebd0b27-9582-4df9-afac-cc9994d56048 tempest-AttachVolumeShelveTestJSON-1155730873 None] deleting rbd volume volume-f0af00c0-1332-46a0-b28a-878815945d12 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:21:30.071809 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-2ebd0b27-9582-4df9-afac-cc9994d56048 tempest-AttachVolumeShelveTestJSON-1155730873 None] Created reservations ['f22c9438-9fb1-48f5-8aac-70e730ccda49', '40aa33b4-4de8-4f95-8a50-2cdc29dc3d09', '2188b12e-e178-4f9f-a9ec-888c6bf19f6c', '0a266b38-9d59-44ef-890e-d0a19dfc1c35'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:30.215202 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2ebd0b27-9582-4df9-afac-cc9994d56048 tempest-AttachVolumeShelveTestJSON-1155730873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:30.267340 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2ebd0b27-9582-4df9-afac-cc9994d56048 tempest-AttachVolumeShelveTestJSON-1155730873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:30.304558 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-2ebd0b27-9582-4df9-afac-cc9994d56048 tempest-AttachVolumeShelveTestJSON-1155730873 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:21:30.311255 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2ebd0b27-9582-4df9-afac-cc9994d56048 tempest-AttachVolumeShelveTestJSON-1155730873 None] Deleted volume successfully. Jun 04 21:21:30.326042 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2ebd0b27-9582-4df9-afac-cc9994d56048 tempest-AttachVolumeShelveTestJSON-1155730873 None] Lock "b'cinder-f0af00c0-1332-46a0-b28a-878815945d12-delete_volume'" released by "delete_volume" :: held 0.889s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:31.850947 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:21:31.877042 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (5379a099-a2e1-4152-8fa9-c535b1d94e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:21:31.884480 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832ea0c9-9a0b-4a53-83fe-89a7a2354c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:31.904571 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832ea0c9-9a0b-4a53-83fe-89a7a2354c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1060359433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b3be1cfb-8953-4216-9eb9-71d5677ba9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e56305a8994e3ca45920448336ba18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:21:32Z,use_quota=True,user_id='59e619953f32406891051e0e029c1670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:31.911266 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b39cad-6f9f-4897-a398-8d8539a1c9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:31.916035 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b39cad-6f9f-4897-a398-8d8539a1c9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:31.922179 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a618668-ecc9-41cd-a467-83ccc693b7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:31.927758 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a618668-ecc9-41cd-a467-83ccc693b7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3be1cfb-8953-4216-9eb9-71d5677ba9c8', 'volume_name': 'volume-b3be1cfb-8953-4216-9eb9-71d5677ba9c8', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:31.933697 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f40600-7c68-41e4-a394-559029426e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:31.938097 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f40600-7c68-41e4-a394-559029426e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:31.944257 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5edee1f-ec73-4aef-a088-214ec7fd9eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:31.945997 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume b3be1cfb-8953-4216-9eb9-71d5677ba9c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3be1cfb-8953-4216-9eb9-71d5677ba9c8', 'volume_size': 1} Jun 04 21:21:31.946545 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] creating volume 'volume-b3be1cfb-8953-4216-9eb9-71d5677ba9c8' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:21:31.947621 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:32.068489 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:21:32.068963 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:21:32.072880 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5edee1f-ec73-4aef-a088-214ec7fd9eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3be1cfb-8953-4216-9eb9-71d5677ba9c8', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:32.077522 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8cdb40-8005-4b66-b83f-14288f0f8247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:32.103847 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume volume-b3be1cfb-8953-4216-9eb9-71d5677ba9c8 (b3be1cfb-8953-4216-9eb9-71d5677ba9c8): created successfully Jun 04 21:21:32.108126 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8cdb40-8005-4b66-b83f-14288f0f8247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:32.120776 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (5379a099-a2e1-4152-8fa9-c535b1d94e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:21:32.150278 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-448ab421-8788-441a-8318-060a6f1971d5 tempest-VolumesSnapshotTestJSON-1648955989 None] Created volume successfully. Jun 04 21:21:33.236580 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9cf009f3-10f5-476c-a288-c5b0f2dab6e3 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:33.613972 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9cf009f3-10f5-476c-a288-c5b0f2dab6e3 tempest-VolumesSnapshotTestJSON-1648955989 None] Create snapshot completed successfully Jun 04 21:21:35.003576 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:21:35.053432 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (c1bde9e9-e2f0-403a-a41d-c38e9fe690c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:21:35.062395 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11079cab-2f25-4f14-a8c8-f46e9fa0828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:35.085298 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11079cab-2f25-4f14-a8c8-f46e9fa0828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-255237588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=abcbfdbb-d59d-4f7c-ab24-8686de9d06b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e56305a8994e3ca45920448336ba18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:21:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d4812688-f289-444f-967c-52cbaa660d6b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:21:35Z,use_quota=True,user_id='59e619953f32406891051e0e029c1670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:35.093394 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e143bd-aeb2-4fd9-88b9-1fcadd2f1f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:35.099496 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e143bd-aeb2-4fd9-88b9-1fcadd2f1f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:35.105512 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558f35d6-4dea-46e7-84ee-ddb26bbac490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:35.110978 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558f35d6-4dea-46e7-84ee-ddb26bbac490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'abcbfdbb-d59d-4f7c-ab24-8686de9d06b2', 'volume_name': 'volume-abcbfdbb-d59d-4f7c-ab24-8686de9d06b2', 'volume_size': 2, 'snapshot_id': 'd4812688-f289-444f-967c-52cbaa660d6b'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:35.120389 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a3c600-4c24-45f1-b4a0-948f1d9934fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:35.125529 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a3c600-4c24-45f1-b4a0-948f1d9934fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:35.131042 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68363760-3add-4a5c-814d-0589ca9776ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:35.132625 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Volume abcbfdbb-d59d-4f7c-ab24-8686de9d06b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-abcbfdbb-d59d-4f7c-ab24-8686de9d06b2', 'volume_size': 2, 'snapshot_id': 'd4812688-f289-444f-967c-52cbaa660d6b'} Jun 04 21:21:35.206088 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] cloning volumes/volume-b3be1cfb-8953-4216-9eb9-71d5677ba9c8@snapshot-d4812688-f289-444f-967c-52cbaa660d6b to volume-abcbfdbb-d59d-4f7c-ab24-8686de9d06b2 {{(pid=130490) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} Jun 04 21:21:35.207113 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:35.301258 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:35.529930 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:21:35.530689 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:21:35.536053 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:35.719958 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68363760-3add-4a5c-814d-0589ca9776ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abcbfdbb-d59d-4f7c-ab24-8686de9d06b2', 'volume_size': 2, 'snapshot_id': 'd4812688-f289-444f-967c-52cbaa660d6b'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:35.727602 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695e38db-d327-4056-bf6d-90e38f6ed61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:35.739129 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Volume volume-abcbfdbb-d59d-4f7c-ab24-8686de9d06b2 (abcbfdbb-d59d-4f7c-ab24-8686de9d06b2): created successfully Jun 04 21:21:35.743182 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695e38db-d327-4056-bf6d-90e38f6ed61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:35.748601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (c1bde9e9-e2f0-403a-a41d-c38e9fe690c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:21:35.764518 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b965c52a-0d08-4766-b3ab-2f10ff4f47ba tempest-VolumesSnapshotTestJSON-1648955989 None] Created volume successfully. Jun 04 21:21:36.106811 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2018dc2c-d01b-48f2-9b08-5abb23f31271 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-abcbfdbb-d59d-4f7c-ab24-8686de9d06b2-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:21:36.177913 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2018dc2c-d01b-48f2-9b08-5abb23f31271 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:36.273805 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2018dc2c-d01b-48f2-9b08-5abb23f31271 tempest-VolumesSnapshotTestJSON-1648955989 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:21:36.287745 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2018dc2c-d01b-48f2-9b08-5abb23f31271 tempest-VolumesSnapshotTestJSON-1648955989 None] deleting rbd volume volume-abcbfdbb-d59d-4f7c-ab24-8686de9d06b2 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:21:36.630644 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=64,cinder:INSERT=6,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:36.646955 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-2018dc2c-d01b-48f2-9b08-5abb23f31271 tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['88be6555-dac8-40e5-afa4-547ac715d554', '5911bfd5-c61b-42da-a345-3ee4d4f47e94', 'b4e98904-df5e-4bb9-b951-31d3156feb62', '83589f75-c0ab-421f-90d3-43712bf8bb58'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:36.653335 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=61,cinder:INSERT=10,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:36.720697 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2018dc2c-d01b-48f2-9b08-5abb23f31271 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:36.780278 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2018dc2c-d01b-48f2-9b08-5abb23f31271 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:36.866523 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-2018dc2c-d01b-48f2-9b08-5abb23f31271 tempest-VolumesSnapshotTestJSON-1648955989 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:21:36.872255 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2018dc2c-d01b-48f2-9b08-5abb23f31271 tempest-VolumesSnapshotTestJSON-1648955989 None] Deleted volume successfully. Jun 04 21:21:36.894090 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2018dc2c-d01b-48f2-9b08-5abb23f31271 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-abcbfdbb-d59d-4f7c-ab24-8686de9d06b2-delete_volume'" released by "delete_volume" :: held 0.789s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:37.707564 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:21:37.727110 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (94a29f41-84ea-4a9b-b7ba-5f9958bc6e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:21:37.733489 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3754b1-88b6-4c2a-ac56-3721dc11b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:37.750398 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3754b1-88b6-4c2a-ac56-3721dc11b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-534996766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a5de4972-6dc4-429f-8b45-19652bd55b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e56305a8994e3ca45920448336ba18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:21:38Z,use_quota=True,user_id='59e619953f32406891051e0e029c1670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:37.763411 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb45601-8e07-4d1a-80a0-c77ab9a7f147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:37.768493 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb45601-8e07-4d1a-80a0-c77ab9a7f147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:37.773508 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79849d4-7d62-4c1f-98c2-809203da3a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:37.777913 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79849d4-7d62-4c1f-98c2-809203da3a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5de4972-6dc4-429f-8b45-19652bd55b0e', 'volume_name': 'volume-a5de4972-6dc4-429f-8b45-19652bd55b0e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:37.782714 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9136ae3b-58a7-4a4e-b553-3c386a5380c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:37.788756 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9136ae3b-58a7-4a4e-b553-3c386a5380c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:37.795806 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff227dc-68c9-4198-8bbf-257a67d3c7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:37.796931 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume a5de4972-6dc4-429f-8b45-19652bd55b0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5de4972-6dc4-429f-8b45-19652bd55b0e', 'volume_size': 1} Jun 04 21:21:37.797506 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] creating volume 'volume-a5de4972-6dc4-429f-8b45-19652bd55b0e' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:21:37.798560 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:37.906927 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:21:37.907331 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:21:37.911250 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff227dc-68c9-4198-8bbf-257a67d3c7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5de4972-6dc4-429f-8b45-19652bd55b0e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:37.917322 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eda6735-8434-47f6-8d10-79fb1979ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:37.930851 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume volume-a5de4972-6dc4-429f-8b45-19652bd55b0e (a5de4972-6dc4-429f-8b45-19652bd55b0e): created successfully Jun 04 21:21:37.934895 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eda6735-8434-47f6-8d10-79fb1979ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:37.941208 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (94a29f41-84ea-4a9b-b7ba-5f9958bc6e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:21:37.957485 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9c2215c0-743b-428d-afeb-ad14140c1ad1 tempest-VolumesSnapshotTestJSON-1648955989 None] Created volume successfully. Jun 04 21:21:39.003140 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fd2600b8-ae7c-4c91-8e85-8f065841d402 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:39.761624 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-fd2600b8-ae7c-4c91-8e85-8f065841d402 tempest-VolumesSnapshotTestJSON-1648955989 None] Create snapshot completed successfully Jun 04 21:21:40.633073 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:21:40.666496 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (7a3aa7ad-e149-4f3c-9308-ea14e9fb2ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:21:40.673010 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d368cc0b-1cf5-446c-99ba-a1f0e6fc0b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:40.691971 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d368cc0b-1cf5-446c-99ba-a1f0e6fc0b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-970297793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9bea8164-55a9-4c4d-aac6-365eee58b5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e56305a8994e3ca45920448336ba18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=064643bb-e7a2-4d52-9fa7-5aed90cb9967,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:21:41Z,use_quota=True,user_id='59e619953f32406891051e0e029c1670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:40.697285 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2d7a0e-7a38-41a9-888c-2037c2f8b8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:40.707673 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2d7a0e-7a38-41a9-888c-2037c2f8b8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:40.712646 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926b7f55-cd48-4305-b0ca-ae6b7ad0ed03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:40.716593 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926b7f55-cd48-4305-b0ca-ae6b7ad0ed03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9bea8164-55a9-4c4d-aac6-365eee58b5be', 'volume_name': 'volume-9bea8164-55a9-4c4d-aac6-365eee58b5be', 'volume_size': 1, 'snapshot_id': '064643bb-e7a2-4d52-9fa7-5aed90cb9967'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:40.721315 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42416d20-e461-417a-b415-6581c963daf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:40.725077 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42416d20-e461-417a-b415-6581c963daf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:40.730125 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047a8198-65a5-4e82-97f7-08443f0a2936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:40.731439 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume 9bea8164-55a9-4c4d-aac6-365eee58b5be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9bea8164-55a9-4c4d-aac6-365eee58b5be', 'volume_size': 1, 'snapshot_id': '064643bb-e7a2-4d52-9fa7-5aed90cb9967'} Jun 04 21:21:40.751723 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] cloning volumes/volume-a5de4972-6dc4-429f-8b45-19652bd55b0e@snapshot-064643bb-e7a2-4d52-9fa7-5aed90cb9967 to volume-9bea8164-55a9-4c4d-aac6-365eee58b5be {{(pid=130490) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} Jun 04 21:21:40.752422 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:40.817333 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:40.988068 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:21:40.988654 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:21:41.011060 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047a8198-65a5-4e82-97f7-08443f0a2936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bea8164-55a9-4c4d-aac6-365eee58b5be', 'volume_size': 1, 'snapshot_id': '064643bb-e7a2-4d52-9fa7-5aed90cb9967'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:41.016852 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8296bff-805e-4538-9e95-f9d8b891dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:21:41.035718 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume volume-9bea8164-55a9-4c4d-aac6-365eee58b5be (9bea8164-55a9-4c4d-aac6-365eee58b5be): created successfully Jun 04 21:21:41.039417 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8296bff-805e-4538-9e95-f9d8b891dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:21:41.046782 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Flow 'volume_create_manager' (7a3aa7ad-e149-4f3c-9308-ea14e9fb2ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:21:41.067785 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3571e6ff-83f4-460a-84ed-5fcb4288fc97 tempest-VolumesSnapshotTestJSON-1648955989 None] Created volume successfully. Jun 04 21:21:41.740907 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-4f534a0d-9b61-4dfa-92da-516d9562175a tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-9bea8164-55a9-4c4d-aac6-365eee58b5be-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:21:41.781297 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4f534a0d-9b61-4dfa-92da-516d9562175a tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:41.849667 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4f534a0d-9b61-4dfa-92da-516d9562175a tempest-VolumesSnapshotTestJSON-1648955989 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:21:41.864783 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4f534a0d-9b61-4dfa-92da-516d9562175a tempest-VolumesSnapshotTestJSON-1648955989 None] deleting rbd volume volume-9bea8164-55a9-4c4d-aac6-365eee58b5be {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:21:42.281832 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-4f534a0d-9b61-4dfa-92da-516d9562175a tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['92fcd206-3339-4818-80a0-ff2a31e5f2df', '97486bc7-6423-4d9d-bf60-9dee45ae537e', 'c78c3e73-a3c3-493a-8f1b-c8e0a5ab4b6e', '54a3966b-dbeb-4820-8807-854650aa5107'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:42.339947 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4f534a0d-9b61-4dfa-92da-516d9562175a tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:42.404029 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4f534a0d-9b61-4dfa-92da-516d9562175a tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:42.472487 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-4f534a0d-9b61-4dfa-92da-516d9562175a tempest-VolumesSnapshotTestJSON-1648955989 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:21:42.478887 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4f534a0d-9b61-4dfa-92da-516d9562175a tempest-VolumesSnapshotTestJSON-1648955989 None] Deleted volume successfully. Jun 04 21:21:42.503783 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-4f534a0d-9b61-4dfa-92da-516d9562175a tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-9bea8164-55a9-4c4d-aac6-365eee58b5be-delete_volume'" released by "delete_volume" :: held 0.763s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:42.939425 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-fd34209f-ebe7-4f03-8da8-365f03ee91e7 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-064643bb-e7a2-4d52-9fa7-5aed90cb9967-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:21:42.941774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fd34209f-ebe7-4f03-8da8-365f03ee91e7 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:43.906147 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-fd34209f-ebe7-4f03-8da8-365f03ee91e7 tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['c8576033-876f-42c1-b420-07391bccaa72', '63012a06-d3a1-4ca0-9db4-15c282f76f96', '5b87167e-906d-4a73-b37e-fddaee629812', '328b4ef5-3045-42a2-bf05-56ddd0d6fb5b'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:44.028620 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-fd34209f-ebe7-4f03-8da8-365f03ee91e7 tempest-VolumesSnapshotTestJSON-1648955989 None] Delete snapshot completed successfully. Jun 04 21:21:44.035442 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-fd34209f-ebe7-4f03-8da8-365f03ee91e7 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-064643bb-e7a2-4d52-9fa7-5aed90cb9967-delete_snapshot'" released by "delete_snapshot" :: held 1.096s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:44.116439 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-be3946e1-690b-42b5-8d4a-08a11699c550 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-a5de4972-6dc4-429f-8b45-19652bd55b0e-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:21:44.196260 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be3946e1-690b-42b5-8d4a-08a11699c550 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:44.266641 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be3946e1-690b-42b5-8d4a-08a11699c550 tempest-VolumesSnapshotTestJSON-1648955989 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:21:44.267032 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be3946e1-690b-42b5-8d4a-08a11699c550 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume volume-a5de4972-6dc4-429f-8b45-19652bd55b0e is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:21:44.285588 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be3946e1-690b-42b5-8d4a-08a11699c550 tempest-VolumesSnapshotTestJSON-1648955989 None] deleting rbd volume volume-a5de4972-6dc4-429f-8b45-19652bd55b0e {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:21:44.686972 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-be3946e1-690b-42b5-8d4a-08a11699c550 tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['a9bf0195-81ed-4a45-9011-bab65fdeecdf', 'b35cedaf-da8d-4330-bc88-1d31e6b1ccb7', '0d9f8056-4feb-48b2-8a5e-eeeefa872d95', '88a886b9-2f76-4604-ad5a-43dc6ace1df4'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:44.748303 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be3946e1-690b-42b5-8d4a-08a11699c550 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:44.810860 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be3946e1-690b-42b5-8d4a-08a11699c550 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:44.856478 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-be3946e1-690b-42b5-8d4a-08a11699c550 tempest-VolumesSnapshotTestJSON-1648955989 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:21:44.866058 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-be3946e1-690b-42b5-8d4a-08a11699c550 tempest-VolumesSnapshotTestJSON-1648955989 None] Deleted volume successfully. Jun 04 21:21:44.882884 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-be3946e1-690b-42b5-8d4a-08a11699c550 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-a5de4972-6dc4-429f-8b45-19652bd55b0e-delete_volume'" released by "delete_volume" :: held 0.766s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:45.349936 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ce80b284-6aad-44b2-843f-8c46353c3ff3 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-d4812688-f289-444f-967c-52cbaa660d6b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:21:45.356231 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ce80b284-6aad-44b2-843f-8c46353c3ff3 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:45.830666 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=30,cinder:SELECT=60,cinder:DELETE=3,cinder:INSERT=7 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:45.858297 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=55,cinder:UPDATE=37,cinder:DELETE=3,cinder:INSERT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:45.896719 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-ce80b284-6aad-44b2-843f-8c46353c3ff3 tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['a476c500-cb43-4da2-962d-0938ff7fd5f7', '888ad0d5-1cee-4757-b353-ead32413499e', '9ebf4dc1-daa9-4539-9e1b-76b4afb1c15b', '28c02a47-8b65-4eae-acee-3adce2cadfe1'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:45.949950 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ce80b284-6aad-44b2-843f-8c46353c3ff3 tempest-VolumesSnapshotTestJSON-1648955989 None] Delete snapshot completed successfully. Jun 04 21:21:45.955466 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ce80b284-6aad-44b2-843f-8c46353c3ff3 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-d4812688-f289-444f-967c-52cbaa660d6b-delete_snapshot'" released by "delete_snapshot" :: held 0.607s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:46.060746 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:21:46.061755 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:46.100506 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:46.147861 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:21:46.542368 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c7dcfc2a-948e-4abf-964f-c4e3cd682c07 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-b3be1cfb-8953-4216-9eb9-71d5677ba9c8-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:21:46.616664 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c7dcfc2a-948e-4abf-964f-c4e3cd682c07 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:46.701675 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c7dcfc2a-948e-4abf-964f-c4e3cd682c07 tempest-VolumesSnapshotTestJSON-1648955989 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:21:46.702559 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c7dcfc2a-948e-4abf-964f-c4e3cd682c07 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume volume-b3be1cfb-8953-4216-9eb9-71d5677ba9c8 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:21:46.713916 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c7dcfc2a-948e-4abf-964f-c4e3cd682c07 tempest-VolumesSnapshotTestJSON-1648955989 None] deleting rbd volume volume-b3be1cfb-8953-4216-9eb9-71d5677ba9c8 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:21:47.093904 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-c7dcfc2a-948e-4abf-964f-c4e3cd682c07 tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['2f9bc1a3-df0b-427c-aae8-8293f2e245db', '5094aaa1-8c4c-4bb2-a407-10fbd7b6c30c', 'e197d30f-d1c5-41fb-879b-f55288a9f0c3', '2e717464-0fa4-43e3-bdf1-f38a44866924'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:47.165684 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c7dcfc2a-948e-4abf-964f-c4e3cd682c07 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:47.222228 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c7dcfc2a-948e-4abf-964f-c4e3cd682c07 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:47.294870 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-c7dcfc2a-948e-4abf-964f-c4e3cd682c07 tempest-VolumesSnapshotTestJSON-1648955989 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:21:47.299304 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c7dcfc2a-948e-4abf-964f-c4e3cd682c07 tempest-VolumesSnapshotTestJSON-1648955989 None] Deleted volume successfully. Jun 04 21:21:47.317345 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-c7dcfc2a-948e-4abf-964f-c4e3cd682c07 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-b3be1cfb-8953-4216-9eb9-71d5677ba9c8-delete_volume'" released by "delete_volume" :: held 0.775s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:47.898737 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-3653e205-45ec-46b3-95f9-bebd5c89c493-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:21:47.955459 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:48.035494 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:21:48.049686 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] deleting rbd volume volume-3653e205-45ec-46b3-95f9-bebd5c89c493 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:21:48.530154 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:21:48.582863 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] deleting parent snapshot volume-3653e205-45ec-46b3-95f9-bebd5c89c493.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:21:49.039915 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['de7b0561-1e73-4e6f-bfaf-2b06b8d27978', '0c71e378-3f98-4447-9a42-9c4ae7414871', 'a215c9ae-61a3-432e-b792-942c4a8d0909', '959abe6a-1895-43a0-a458-6b1b8451e56a'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:49.102239 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:49.169184 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:49.223225 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:21:49.228956 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] Deleted volume successfully. Jun 04 21:21:49.248124 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0f1640a0-9aa7-4198-8e10-fda8036a81f4 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-3653e205-45ec-46b3-95f9-bebd5c89c493-delete_volume'" released by "delete_volume" :: held 1.350s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:50.156183 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-19fbf196-198c-4ce1-bdcd-9049fc4a9913 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-381b580f-61c1-4781-b5c2-7fb78658db63-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.028s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:21:50.166601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-19fbf196-198c-4ce1-bdcd-9049fc4a9913 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:51.039494 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-19fbf196-198c-4ce1-bdcd-9049fc4a9913 tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['78ea7510-436e-47a2-b5f1-dfe5d9113825', 'ef0e90ab-8abc-4716-bd23-8406313fa77e', 'ba276ff6-6d7b-4821-ac32-3f8d49b92b9e', '10986b00-79a5-4799-b9ec-0ecc5d7347ce'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:51.081760 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-19fbf196-198c-4ce1-bdcd-9049fc4a9913 tempest-VolumesSnapshotTestJSON-1648955989 None] Delete snapshot completed successfully. Jun 04 21:21:51.087774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-19fbf196-198c-4ce1-bdcd-9049fc4a9913 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-381b580f-61c1-4781-b5c2-7fb78658db63-delete_snapshot'" released by "delete_snapshot" :: held 0.932s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:51.304404 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-32f93312-0d49-4198-b1c5-2bd276a10eb3 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-1cc49d5c-997d-437a-81e2-dc8b803becae-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:21:51.347076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f93312-0d49-4198-b1c5-2bd276a10eb3 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:51.430907 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f93312-0d49-4198-b1c5-2bd276a10eb3 tempest-VolumesSnapshotTestJSON-1648955989 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:21:51.431697 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f93312-0d49-4198-b1c5-2bd276a10eb3 tempest-VolumesSnapshotTestJSON-1648955989 None] Volume volume-1cc49d5c-997d-437a-81e2-dc8b803becae is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:21:51.442807 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f93312-0d49-4198-b1c5-2bd276a10eb3 tempest-VolumesSnapshotTestJSON-1648955989 None] deleting rbd volume volume-1cc49d5c-997d-437a-81e2-dc8b803becae {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:21:51.782176 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-32f93312-0d49-4198-b1c5-2bd276a10eb3 tempest-VolumesSnapshotTestJSON-1648955989 None] Created reservations ['ad4c0342-37f0-4623-9a45-d5737dec5b50', 'd94be69a-150b-4294-a3df-aa01c260fb72', '59d5b5a3-ce5a-4d09-86e9-85a3d854e68a', 'fd2d6b1d-71e8-4b3a-98d4-47a720f79783'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:21:51.849337 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f93312-0d49-4198-b1c5-2bd276a10eb3 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:51.908536 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-32f93312-0d49-4198-b1c5-2bd276a10eb3 tempest-VolumesSnapshotTestJSON-1648955989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:21:51.936964 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-32f93312-0d49-4198-b1c5-2bd276a10eb3 tempest-VolumesSnapshotTestJSON-1648955989 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:21:51.942266 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-32f93312-0d49-4198-b1c5-2bd276a10eb3 tempest-VolumesSnapshotTestJSON-1648955989 None] Deleted volume successfully. Jun 04 21:21:51.964096 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-32f93312-0d49-4198-b1c5-2bd276a10eb3 tempest-VolumesSnapshotTestJSON-1648955989 None] Lock "b'cinder-1cc49d5c-997d-437a-81e2-dc8b803becae-delete_volume'" released by "delete_volume" :: held 0.660s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:21:55.142806 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=46,cinder:INSERT=13,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:05.231273 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:22:05.310204 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Flow 'volume_create_manager' (c18cbf66-2b4d-4df3-8348-adfbcaf0fbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:05.331645 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cee42b-fc14-4d48-83c8-fc645d87e288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:05.348150 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=59,cinder:UPDATE=34,cinder:INSERT=7 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:05.388889 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cee42b-fc14-4d48-83c8-fc645d87e288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-264287268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=98470abe-f55c-4c36-8d51-fc050f6a1e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed013dca03534a42a3a99593e56d0162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:22:05Z,use_quota=True,user_id='6343f086d9584796aba71988b14570f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:05.395435 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a64d5d5-1f60-44dc-81a1-8987b541a5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:05.402025 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a64d5d5-1f60-44dc-81a1-8987b541a5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:05.408762 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ad466f-7637-46e1-9b31-43e7014d66f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:05.413438 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ad466f-7637-46e1-9b31-43e7014d66f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98470abe-f55c-4c36-8d51-fc050f6a1e34', 'volume_name': 'volume-98470abe-f55c-4c36-8d51-fc050f6a1e34', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:05.418766 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e2c842-ce83-43b0-a60a-cc1ca47502b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:05.423661 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e2c842-ce83-43b0-a60a-cc1ca47502b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:05.429953 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebd75fd-d33f-4a7e-b21c-573c61056ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:05.431381 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Volume 98470abe-f55c-4c36-8d51-fc050f6a1e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98470abe-f55c-4c36-8d51-fc050f6a1e34', 'volume_size': 1} Jun 04 21:22:05.432046 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] creating volume 'volume-98470abe-f55c-4c36-8d51-fc050f6a1e34' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:22:05.433016 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:05.583502 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:22:05.584295 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:22:05.588850 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebd75fd-d33f-4a7e-b21c-573c61056ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98470abe-f55c-4c36-8d51-fc050f6a1e34', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:05.597275 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a267d706-55ea-4076-bc8f-d68dbf4efe87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:05.613816 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Volume volume-98470abe-f55c-4c36-8d51-fc050f6a1e34 (98470abe-f55c-4c36-8d51-fc050f6a1e34): created successfully Jun 04 21:22:05.628924 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a267d706-55ea-4076-bc8f-d68dbf4efe87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:05.641680 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Flow 'volume_create_manager' (c18cbf66-2b4d-4df3-8348-adfbcaf0fbd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:05.671089 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-1e127f1c-a59e-473c-8c56-2f4b733c3111 tempest-AttachVolumeNegativeTest-475698259 None] Created volume successfully. Jun 04 21:22:07.200241 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-3755363c-1c9b-4621-a86f-d05f4f92cf9f req-836d20ca-aabf-4b5e-8c09-9bcbe21a061b tempest-AttachVolumeNegativeTest-475698259 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:22:09.558006 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-3755363c-1c9b-4621-a86f-d05f4f92cf9f req-836d20ca-aabf-4b5e-8c09-9bcbe21a061b tempest-AttachVolumeNegativeTest-475698259 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.358s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:22:09.559668 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-3755363c-1c9b-4621-a86f-d05f4f92cf9f req-836d20ca-aabf-4b5e-8c09-9bcbe21a061b tempest-AttachVolumeNegativeTest-475698259 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-98470abe-f55c-4c36-8d51-fc050f6a1e34', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '98470abe-f55c-4c36-8d51-fc050f6a1e34', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:22:09.617350 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-3755363c-1c9b-4621-a86f-d05f4f92cf9f req-836d20ca-aabf-4b5e-8c09-9bcbe21a061b tempest-AttachVolumeNegativeTest-475698259 None] Connection info returned from driver {'name': 'volumes/volume-98470abe-f55c-4c36-8d51-fc050f6a1e34', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '98470abe-f55c-4c36-8d51-fc050f6a1e34', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '38d09fe6-a321-427d-b0ce-0e8cc8d8452d'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:22:09.731871 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-3755363c-1c9b-4621-a86f-d05f4f92cf9f req-836d20ca-aabf-4b5e-8c09-9bcbe21a061b tempest-AttachVolumeNegativeTest-475698259 None] attachment_update completed successfully. Jun 04 21:22:14.073872 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-68726f4a-cb80-4ec1-a418-10e1d6278e8a req-31ca6a91-dff9-4217-b12a-e7e825e13580 tempest-AttachVolumeNegativeTest-475698259 None] Terminate volume connection completed successfully. Jun 04 21:22:14.074944 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-68726f4a-cb80-4ec1-a418-10e1d6278e8a req-31ca6a91-dff9-4217-b12a-e7e825e13580 tempest-AttachVolumeNegativeTest-475698259 None] Deleting attachment 38d09fe6-a321-427d-b0ce-0e8cc8d8452d. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:22:21.188838 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-afce08c0-f6c4-4d91-9471-95e31bfa0905 req-276aaa6a-b8bb-4c5d-9d9c-bdda04ccb3ae tempest-TestVolumeBootPattern-524389578 None] Terminate volume connection completed successfully. Jun 04 21:22:21.189537 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-afce08c0-f6c4-4d91-9471-95e31bfa0905 req-276aaa6a-b8bb-4c5d-9d9c-bdda04ccb3ae tempest-TestVolumeBootPattern-524389578 None] Deleting attachment 3325486d-f3d3-4408-9809-51d717bc3e84. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:22:26.796440 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-35aeecff-ac94-4434-98aa-a0618acf0fa0 req-a8fd0b25-2d03-4941-97e6-2522ce694601 tempest-TestVolumeBootPattern-524389578 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:22:27.814684 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-35aeecff-ac94-4434-98aa-a0618acf0fa0 req-a8fd0b25-2d03-4941-97e6-2522ce694601 tempest-TestVolumeBootPattern-524389578 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.020s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:22:27.815785 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-35aeecff-ac94-4434-98aa-a0618acf0fa0 req-a8fd0b25-2d03-4941-97e6-2522ce694601 tempest-TestVolumeBootPattern-524389578 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6121e434-b2b6-4783-9a4b-90d85dc648ef', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '6121e434-b2b6-4783-9a4b-90d85dc648ef', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:22:27.853291 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-35aeecff-ac94-4434-98aa-a0618acf0fa0 req-a8fd0b25-2d03-4941-97e6-2522ce694601 tempest-TestVolumeBootPattern-524389578 None] Connection info returned from driver {'name': 'volumes/volume-6121e434-b2b6-4783-9a4b-90d85dc648ef', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6121e434-b2b6-4783-9a4b-90d85dc648ef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ca405595-cc46-42fd-9552-cdc6f30b7be3'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:22:27.919123 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-35aeecff-ac94-4434-98aa-a0618acf0fa0 req-a8fd0b25-2d03-4941-97e6-2522ce694601 tempest-TestVolumeBootPattern-524389578 None] attachment_update completed successfully. Jun 04 21:22:38.231900 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=30,cinder:UPDATE=7 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:38.233555 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=38,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:38.262878 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:22:38.287416 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Flow 'volume_create_manager' (985c4e1e-2d1e-4359-95f7-ad039baebe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:38.295982 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c0f154-f2ba-4972-918c-1b3eb0a1f003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:38.315739 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c0f154-f2ba-4972-918c-1b3eb0a1f003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1312500790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b98faacc-4f27-457e-a796-aaf467022750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a62299d8e84bafb9dca55eda2a64c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:22:38Z,use_quota=True,user_id='be2f1a2db90f41b4a4214b4fa91779d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92b691b5-23e9-4fd0-b00e-6cf926ae523e),volume_type_id=92b691b5-23e9-4fd0-b00e-6cf926ae523e)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:38.320927 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7329a7-386b-4c5a-90b4-b2e84939f6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:38.324934 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7329a7-386b-4c5a-90b4-b2e84939f6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:38.329906 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0823476c-61ab-4a76-b4c8-47cd474c1385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:38.333921 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0823476c-61ab-4a76-b4c8-47cd474c1385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98faacc-4f27-457e-a796-aaf467022750', 'volume_name': 'volume-b98faacc-4f27-457e-a796-aaf467022750', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:38.338653 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80065bc9-1e08-4b31-abd6-726c8a141ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:38.342469 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80065bc9-1e08-4b31-abd6-726c8a141ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:38.346978 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b49cd8d-0e5f-44a4-a82c-39fba832df81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:38.348840 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Volume b98faacc-4f27-457e-a796-aaf467022750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98faacc-4f27-457e-a796-aaf467022750', 'volume_size': 1} Jun 04 21:22:38.349509 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] creating volume 'volume-b98faacc-4f27-457e-a796-aaf467022750' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:22:38.350618 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:38.428668 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:22:38.429053 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:22:38.432719 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b49cd8d-0e5f-44a4-a82c-39fba832df81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98faacc-4f27-457e-a796-aaf467022750', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:38.438148 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c58649-3f63-4376-a3f7-845988ad4aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:38.453396 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Volume volume-b98faacc-4f27-457e-a796-aaf467022750 (b98faacc-4f27-457e-a796-aaf467022750): created successfully Jun 04 21:22:38.457455 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c58649-3f63-4376-a3f7-845988ad4aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:38.464015 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Flow 'volume_create_manager' (985c4e1e-2d1e-4359-95f7-ad039baebe40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:38.475552 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e44c21f7-28c7-45fa-96e6-9d832e7b48b5 tempest-VolumeTypesTest-20628169 None] Created volume successfully. Jun 04 21:22:39.772460 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fca0f54c-b0fe-4232-89d6-68435e2547b8 tempest-VolumeTypesTest-20628169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:39.826665 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fca0f54c-b0fe-4232-89d6-68435e2547b8 tempest-VolumeTypesTest-20628169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:39.861725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-fca0f54c-b0fe-4232-89d6-68435e2547b8 tempest-VolumeTypesTest-20628169 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:22:39.868832 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-fca0f54c-b0fe-4232-89d6-68435e2547b8 tempest-VolumeTypesTest-20628169 None] Retype volume completed successfully. Jun 04 21:22:42.016078 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] Lock "b'cinder-b98faacc-4f27-457e-a796-aaf467022750-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:22:42.081465 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:42.161010 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:22:42.161856 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] Volume volume-b98faacc-4f27-457e-a796-aaf467022750 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:22:42.172319 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] deleting rbd volume volume-b98faacc-4f27-457e-a796-aaf467022750 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:22:42.627358 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1314238037 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1314238037, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:22:42.628529 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1314238037 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1314238037, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:22:42.652606 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] Created reservations ['b5da3951-08ea-4510-94ca-42fe86a1a422', '8c484d65-9074-4890-8d88-0aedf3dac6e1', '6fabf906-d046-4804-9de5-b0b2fe972007', '00b81f47-6269-4f79-b314-9f3da768c8bb'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:22:42.712124 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:42.771208 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:42.828155 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:22:42.834274 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] Deleted volume successfully. Jun 04 21:22:42.857187 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-cf803df7-270e-4e91-8374-1676c9396a8f tempest-VolumeTypesTest-20628169 None] Lock "b'cinder-b98faacc-4f27-457e-a796-aaf467022750-delete_volume'" released by "delete_volume" :: held 0.841s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:22:46.058162 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:22:46.059892 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:46.127389 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:46.183845 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:22:47.259313 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:22:47.280403 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Flow 'volume_create_manager' (d5fa4acc-fa79-493b-86a3-0e4f8234d87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:47.287438 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558f820d-3222-4970-84a5-8b4f9a355144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:47.304196 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558f820d-3222-4970-84a5-8b4f9a355144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1061110049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=89360dca-a37b-4dab-8d21-ab27cd830ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795e383feac2471597372e2fb424e5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:22:47Z,use_quota=True,user_id='3f70afef4c524a478f1b5b4c41bca5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:47.310176 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb893700-2e12-4408-bbdc-69968fe29224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:47.314476 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb893700-2e12-4408-bbdc-69968fe29224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:47.319603 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0f1ded-3071-4467-9914-e0e61b1d7205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:47.324595 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0f1ded-3071-4467-9914-e0e61b1d7205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89360dca-a37b-4dab-8d21-ab27cd830ba0', 'volume_name': 'volume-89360dca-a37b-4dab-8d21-ab27cd830ba0', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:47.329590 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecda42ca-f622-46a6-bd0a-e6864ed485da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:47.333835 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecda42ca-f622-46a6-bd0a-e6864ed485da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:47.339022 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadcdf64-d05b-42ff-bef2-d02f75da7ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:47.340410 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Volume 89360dca-a37b-4dab-8d21-ab27cd830ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89360dca-a37b-4dab-8d21-ab27cd830ba0', 'volume_size': 1} Jun 04 21:22:47.341011 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] creating volume 'volume-89360dca-a37b-4dab-8d21-ab27cd830ba0' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:22:47.342937 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:47.426668 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:22:47.427138 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:22:47.430984 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadcdf64-d05b-42ff-bef2-d02f75da7ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89360dca-a37b-4dab-8d21-ab27cd830ba0', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:47.435474 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e9af82-68ea-4b93-9012-60957edd28d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:47.447376 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Volume volume-89360dca-a37b-4dab-8d21-ab27cd830ba0 (89360dca-a37b-4dab-8d21-ab27cd830ba0): created successfully Jun 04 21:22:47.451352 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e9af82-68ea-4b93-9012-60957edd28d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:47.457430 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Flow 'volume_create_manager' (d5fa4acc-fa79-493b-86a3-0e4f8234d87b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:47.467202 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-134a08fc-3f6e-4906-8307-b5f601a37f8f tempest-VolumesMetadataTest-203641085 None] Created volume successfully. Jun 04 21:22:49.247083 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f9280508-436b-403b-b0f9-6a2968a38a7f tempest-VolumesMetadataTest-203641085 None] Lock "b'cinder-89360dca-a37b-4dab-8d21-ab27cd830ba0-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:22:49.288399 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f9280508-436b-403b-b0f9-6a2968a38a7f tempest-VolumesMetadataTest-203641085 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:49.355640 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f9280508-436b-403b-b0f9-6a2968a38a7f tempest-VolumesMetadataTest-203641085 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:22:49.356106 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f9280508-436b-403b-b0f9-6a2968a38a7f tempest-VolumesMetadataTest-203641085 None] Volume volume-89360dca-a37b-4dab-8d21-ab27cd830ba0 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:22:49.386647 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f9280508-436b-403b-b0f9-6a2968a38a7f tempest-VolumesMetadataTest-203641085 None] deleting rbd volume volume-89360dca-a37b-4dab-8d21-ab27cd830ba0 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:22:49.763213 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-f9280508-436b-403b-b0f9-6a2968a38a7f tempest-VolumesMetadataTest-203641085 None] Created reservations ['778aad99-50d5-480a-b48e-c926f88eff9e', '4e776e9d-da44-4445-b369-d37fa15d6ff4', 'd4c15d46-85b5-4f97-a672-cf04e62694c0', 'e6bddbfa-f14e-4d4d-a657-a0109156a5e0'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:22:49.834207 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f9280508-436b-403b-b0f9-6a2968a38a7f tempest-VolumesMetadataTest-203641085 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:49.877808 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-f9280508-436b-403b-b0f9-6a2968a38a7f tempest-VolumesMetadataTest-203641085 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:49.922431 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-f9280508-436b-403b-b0f9-6a2968a38a7f tempest-VolumesMetadataTest-203641085 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:22:49.928897 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-f9280508-436b-403b-b0f9-6a2968a38a7f tempest-VolumesMetadataTest-203641085 None] Deleted volume successfully. Jun 04 21:22:49.945541 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-f9280508-436b-403b-b0f9-6a2968a38a7f tempest-VolumesMetadataTest-203641085 None] Lock "b'cinder-89360dca-a37b-4dab-8d21-ab27cd830ba0-delete_volume'" released by "delete_volume" :: held 0.699s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:22:52.351275 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:22:52.371876 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Flow 'volume_create_manager' (730b4b15-ca13-4039-adaf-b32c555313fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:52.379203 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0558857-785e-4b65-b039-37cb31d6b2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:52.396639 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0558857-785e-4b65-b039-37cb31d6b2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1988502504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3a70dad3-d778-4561-ba91-d47f8e469d79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='129f116240f944c7b8ccdbb3c70547d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:22:52Z,use_quota=True,user_id='a6469878dcd74ab2bc4989e83ec653a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:52.401894 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a356f54-de99-4720-9dd0-5092d1dfe31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:52.405850 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a356f54-de99-4720-9dd0-5092d1dfe31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:52.410763 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb1251a-c67f-422a-8f80-9a8c755dcd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:52.414667 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb1251a-c67f-422a-8f80-9a8c755dcd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a70dad3-d778-4561-ba91-d47f8e469d79', 'volume_name': 'volume-3a70dad3-d778-4561-ba91-d47f8e469d79', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:52.419407 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819d17d4-d2f9-4339-8019-a20250ba2a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:52.423220 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819d17d4-d2f9-4339-8019-a20250ba2a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:52.427937 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb46554f-992d-4ba9-b010-742d3d3550f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:52.429024 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Volume 3a70dad3-d778-4561-ba91-d47f8e469d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a70dad3-d778-4561-ba91-d47f8e469d79', 'volume_size': 1} Jun 04 21:22:52.429412 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] creating volume 'volume-3a70dad3-d778-4561-ba91-d47f8e469d79' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:22:52.430169 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:52.491883 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:22:52.492258 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:22:52.495900 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb46554f-992d-4ba9-b010-742d3d3550f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a70dad3-d778-4561-ba91-d47f8e469d79', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:52.500322 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c4cbc6-5b4c-4675-9024-1739a2ea9410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:52.511467 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Volume volume-3a70dad3-d778-4561-ba91-d47f8e469d79 (3a70dad3-d778-4561-ba91-d47f8e469d79): created successfully Jun 04 21:22:52.515393 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c4cbc6-5b4c-4675-9024-1739a2ea9410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:52.520738 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Flow 'volume_create_manager' (730b4b15-ca13-4039-adaf-b32c555313fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:52.530708 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4fbdb015-c8b4-44d0-963b-ea0bb8f2bbde tempest-VolumesListTestJSON-98868574 None] Created volume successfully. Jun 04 21:22:53.728196 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:22:53.749585 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Flow 'volume_create_manager' (d8f08bea-9a8c-4dcc-b31c-a5db20d2034c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:53.755836 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529bc6bf-ac05-4215-92ab-314f89964b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:53.772667 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529bc6bf-ac05-4215-92ab-314f89964b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2141560321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='129f116240f944c7b8ccdbb3c70547d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:22:54Z,use_quota=True,user_id='a6469878dcd74ab2bc4989e83ec653a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:53.777685 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5ba03f-6d12-4605-8f10-cba7e0f1f3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:53.781586 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5ba03f-6d12-4605-8f10-cba7e0f1f3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:53.786734 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290b21bf-e218-48d4-a827-673d5f21e641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:53.790568 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290b21bf-e218-48d4-a827-673d5f21e641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86', 'volume_name': 'volume-6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:53.795155 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e9099e-fd02-4a64-9ce6-25266d431333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:53.798809 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e9099e-fd02-4a64-9ce6-25266d431333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:53.803543 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2315c407-a822-4de2-9573-20a5bd1fe016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:53.804607 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Volume 6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86', 'volume_size': 1} Jun 04 21:22:53.804982 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] creating volume 'volume-6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:22:53.805608 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:53.861696 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:22:53.862101 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:22:53.865914 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2315c407-a822-4de2-9573-20a5bd1fe016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:53.870346 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94be3f8-b473-4b61-9765-5e6b440d0847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:53.880904 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Volume volume-6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86 (6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86): created successfully Jun 04 21:22:53.884399 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94be3f8-b473-4b61-9765-5e6b440d0847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:53.890160 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Flow 'volume_create_manager' (d8f08bea-9a8c-4dcc-b31c-a5db20d2034c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:53.899532 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a95948c8-10a5-42bd-8605-cca298ff5a66 tempest-VolumesListTestJSON-98868574 None] Created volume successfully. Jun 04 21:22:55.134575 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:22:55.154322 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Flow 'volume_create_manager' (d4daf281-da43-4879-a117-466585efec36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:55.160680 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d2337b-a479-4536-966d-478868152105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:55.181820 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d2337b-a479-4536-966d-478868152105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1134083439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1a0026f7-199d-4b96-b0ad-b7a84909c40d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='129f116240f944c7b8ccdbb3c70547d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:22:55Z,use_quota=True,user_id='a6469878dcd74ab2bc4989e83ec653a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:55.186922 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213ecc23-0175-4cf3-ba37-3cc4ef1deacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:55.190900 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213ecc23-0175-4cf3-ba37-3cc4ef1deacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:55.195841 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbde90ab-d768-4155-8b20-19a7f444a91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:55.199820 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbde90ab-d768-4155-8b20-19a7f444a91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0026f7-199d-4b96-b0ad-b7a84909c40d', 'volume_name': 'volume-1a0026f7-199d-4b96-b0ad-b7a84909c40d', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:55.204528 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad39830e-2955-4439-9cea-a1531f5dc72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:55.208311 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad39830e-2955-4439-9cea-a1531f5dc72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:55.212834 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a61ab4-4262-461d-ab9b-0474464f11d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:55.214581 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Volume 1a0026f7-199d-4b96-b0ad-b7a84909c40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0026f7-199d-4b96-b0ad-b7a84909c40d', 'volume_size': 1} Jun 04 21:22:55.214581 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] creating volume 'volume-1a0026f7-199d-4b96-b0ad-b7a84909c40d' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:22:55.214906 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:55.270122 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:22:55.270417 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:22:55.274091 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a61ab4-4262-461d-ab9b-0474464f11d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0026f7-199d-4b96-b0ad-b7a84909c40d', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:55.278544 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e10aa56-e5ea-4ea0-840c-a049239a7508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:22:55.289198 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Volume volume-1a0026f7-199d-4b96-b0ad-b7a84909c40d (1a0026f7-199d-4b96-b0ad-b7a84909c40d): created successfully Jun 04 21:22:55.292713 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e10aa56-e5ea-4ea0-840c-a049239a7508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:22:55.298072 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Flow 'volume_create_manager' (d4daf281-da43-4879-a117-466585efec36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:22:55.308006 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-230f05c2-3c61-4e46-99f9-8f09963a21f5 tempest-VolumesListTestJSON-98868574 None] Created volume successfully. Jun 04 21:22:58.989423 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-5b1d4342-bdd0-40d4-b047-882fc1a6a78b tempest-VolumesListTestJSON-98868574 None] Lock "b'cinder-1a0026f7-199d-4b96-b0ad-b7a84909c40d-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:22:59.036299 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b1d4342-bdd0-40d4-b047-882fc1a6a78b tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:59.089850 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b1d4342-bdd0-40d4-b047-882fc1a6a78b tempest-VolumesListTestJSON-98868574 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:22:59.090261 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b1d4342-bdd0-40d4-b047-882fc1a6a78b tempest-VolumesListTestJSON-98868574 None] Volume volume-1a0026f7-199d-4b96-b0ad-b7a84909c40d is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:22:59.097821 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b1d4342-bdd0-40d4-b047-882fc1a6a78b tempest-VolumesListTestJSON-98868574 None] deleting rbd volume volume-1a0026f7-199d-4b96-b0ad-b7a84909c40d {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:22:59.308809 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=60,cinder:UPDATE=31,cinder:DELETE=5,cinder:INSERT=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:59.314889 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=66,cinder:UPDATE=28,cinder:INSERT=4,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:59.346536 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-5b1d4342-bdd0-40d4-b047-882fc1a6a78b tempest-VolumesListTestJSON-98868574 None] Created reservations ['fcd7b30a-f006-4cc2-bf55-cd193c69eeb6', 'c6eabd39-25a6-4189-adad-c8421ba10236', '53f407b8-4faa-483f-8064-3cf6d0e2e533', '36caf160-e8d0-4aed-9949-b995a2a27938'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:22:59.401814 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b1d4342-bdd0-40d4-b047-882fc1a6a78b tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:59.438383 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b1d4342-bdd0-40d4-b047-882fc1a6a78b tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:22:59.477018 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-5b1d4342-bdd0-40d4-b047-882fc1a6a78b tempest-VolumesListTestJSON-98868574 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:22:59.482945 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-5b1d4342-bdd0-40d4-b047-882fc1a6a78b tempest-VolumesListTestJSON-98868574 None] Deleted volume successfully. Jun 04 21:22:59.497758 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-5b1d4342-bdd0-40d4-b047-882fc1a6a78b tempest-VolumesListTestJSON-98868574 None] Lock "b'cinder-1a0026f7-199d-4b96-b0ad-b7a84909c40d-delete_volume'" released by "delete_volume" :: held 0.508s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:23:00.129171 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-efbab8be-40a9-474c-aee6-f66c96e2b11f tempest-VolumesListTestJSON-98868574 None] Lock "b'cinder-6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:23:00.166603 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-efbab8be-40a9-474c-aee6-f66c96e2b11f tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:00.216274 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-efbab8be-40a9-474c-aee6-f66c96e2b11f tempest-VolumesListTestJSON-98868574 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:23:00.216795 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-efbab8be-40a9-474c-aee6-f66c96e2b11f tempest-VolumesListTestJSON-98868574 None] Volume volume-6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:23:00.224191 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-efbab8be-40a9-474c-aee6-f66c96e2b11f tempest-VolumesListTestJSON-98868574 None] deleting rbd volume volume-6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:23:00.458318 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-efbab8be-40a9-474c-aee6-f66c96e2b11f tempest-VolumesListTestJSON-98868574 None] Created reservations ['cb59386d-3f0b-4b09-bfdd-a8b3ada69253', 'f502bb3c-c0a4-4cc7-8dfe-e1ee5b460f43', '8afaaa74-1f46-448e-b325-6ebc1d89b057', 'a44fc667-10c3-4ba2-a5fb-055e30ec87e8'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:23:00.506598 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-efbab8be-40a9-474c-aee6-f66c96e2b11f tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:00.540214 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-efbab8be-40a9-474c-aee6-f66c96e2b11f tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:00.565250 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-efbab8be-40a9-474c-aee6-f66c96e2b11f tempest-VolumesListTestJSON-98868574 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:23:00.570951 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-efbab8be-40a9-474c-aee6-f66c96e2b11f tempest-VolumesListTestJSON-98868574 None] Deleted volume successfully. Jun 04 21:23:00.586346 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-efbab8be-40a9-474c-aee6-f66c96e2b11f tempest-VolumesListTestJSON-98868574 None] Lock "b'cinder-6d0eb2b2-edd8-4ab4-a368-fe61a6d3fc86-delete_volume'" released by "delete_volume" :: held 0.457s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:23:01.301420 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-90fbe832-cf5c-433e-a11e-d822cf621624 tempest-VolumesListTestJSON-98868574 None] Lock "b'cinder-3a70dad3-d778-4561-ba91-d47f8e469d79-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:23:01.344075 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-90fbe832-cf5c-433e-a11e-d822cf621624 tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:01.398977 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-90fbe832-cf5c-433e-a11e-d822cf621624 tempest-VolumesListTestJSON-98868574 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:23:01.399465 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-90fbe832-cf5c-433e-a11e-d822cf621624 tempest-VolumesListTestJSON-98868574 None] Volume volume-3a70dad3-d778-4561-ba91-d47f8e469d79 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:23:01.407817 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-90fbe832-cf5c-433e-a11e-d822cf621624 tempest-VolumesListTestJSON-98868574 None] deleting rbd volume volume-3a70dad3-d778-4561-ba91-d47f8e469d79 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:23:01.640293 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-90fbe832-cf5c-433e-a11e-d822cf621624 tempest-VolumesListTestJSON-98868574 None] Created reservations ['9310924a-1a4a-4676-a624-0736bfe9c03b', '38358ab6-8fd9-458b-865c-059faa3cba8a', '7d58f904-e108-49de-9c2d-c5b0b641bc46', '1b07df2a-32ea-45c8-ad90-26cc8689e4cf'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:23:01.686685 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-90fbe832-cf5c-433e-a11e-d822cf621624 tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:01.712281 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-90fbe832-cf5c-433e-a11e-d822cf621624 tempest-VolumesListTestJSON-98868574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:01.742609 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-90fbe832-cf5c-433e-a11e-d822cf621624 tempest-VolumesListTestJSON-98868574 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:23:01.751891 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-90fbe832-cf5c-433e-a11e-d822cf621624 tempest-VolumesListTestJSON-98868574 None] Deleted volume successfully. Jun 04 21:23:01.765897 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-90fbe832-cf5c-433e-a11e-d822cf621624 tempest-VolumesListTestJSON-98868574 None] Lock "b'cinder-3a70dad3-d778-4561-ba91-d47f8e469d79-delete_volume'" released by "delete_volume" :: held 0.465s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:23:22.242686 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:23:22.274821 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Flow 'volume_create_manager' (23b2591d-9d49-47d8-8781-e6a3d58faabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:23:22.282506 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c45c09-9618-4a78-a4b0-df03ed7077c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:22.301314 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c45c09-9618-4a78-a4b0-df03ed7077c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-652411595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fdb6ada6-677b-4f08-acc2-cd8fe9b67249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed013dca03534a42a3a99593e56d0162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:23:22Z,use_quota=True,user_id='6343f086d9584796aba71988b14570f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:22.308947 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9963d2-cda9-40ec-b6c5-4dd1dca1466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:22.313293 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9963d2-cda9-40ec-b6c5-4dd1dca1466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:22.318433 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfa55db-7a9f-4d9c-9406-f05f8d4392cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:22.322385 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfa55db-7a9f-4d9c-9406-f05f8d4392cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb6ada6-677b-4f08-acc2-cd8fe9b67249', 'volume_name': 'volume-fdb6ada6-677b-4f08-acc2-cd8fe9b67249', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:22.327105 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db05ea6-9a27-410b-b237-09b5cecb23e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:22.330887 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db05ea6-9a27-410b-b237-09b5cecb23e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:22.335772 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f178b6eb-b3b5-45b5-a9f6-09db92cc36d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:22.336843 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Volume fdb6ada6-677b-4f08-acc2-cd8fe9b67249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb6ada6-677b-4f08-acc2-cd8fe9b67249', 'volume_size': 1} Jun 04 21:23:22.337236 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] creating volume 'volume-fdb6ada6-677b-4f08-acc2-cd8fe9b67249' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:23:22.338020 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:22.461757 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:23:22.462235 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:23:22.471060 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f178b6eb-b3b5-45b5-a9f6-09db92cc36d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb6ada6-677b-4f08-acc2-cd8fe9b67249', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:22.478540 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9b47e5-885c-4819-a7ce-0c3762478d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:22.493076 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Volume volume-fdb6ada6-677b-4f08-acc2-cd8fe9b67249 (fdb6ada6-677b-4f08-acc2-cd8fe9b67249): created successfully Jun 04 21:23:22.499623 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9b47e5-885c-4819-a7ce-0c3762478d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:22.508737 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Flow 'volume_create_manager' (23b2591d-9d49-47d8-8781-e6a3d58faabf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:23:22.529998 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-54bbc51a-5eba-411b-9e75-86644ec02124 tempest-AttachVolumeNegativeTest-475698259 None] Created volume successfully. Jun 04 21:23:23.955165 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 req-ddf368d2-3ed9-4147-bd49-cc3f5e04acd2 tempest-AttachVolumeNegativeTest-475698259 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:23:24.760194 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 req-ddf368d2-3ed9-4147-bd49-cc3f5e04acd2 tempest-AttachVolumeNegativeTest-475698259 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.805s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:23:24.761049 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 req-ddf368d2-3ed9-4147-bd49-cc3f5e04acd2 tempest-AttachVolumeNegativeTest-475698259 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fdb6ada6-677b-4f08-acc2-cd8fe9b67249', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'fdb6ada6-677b-4f08-acc2-cd8fe9b67249', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:23:24.798376 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 req-ddf368d2-3ed9-4147-bd49-cc3f5e04acd2 tempest-AttachVolumeNegativeTest-475698259 None] Connection info returned from driver {'name': 'volumes/volume-fdb6ada6-677b-4f08-acc2-cd8fe9b67249', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fdb6ada6-677b-4f08-acc2-cd8fe9b67249', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '01f2a453-9f14-4ae2-90ec-e9e63f3ce026'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:23:24.898136 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 req-ddf368d2-3ed9-4147-bd49-cc3f5e04acd2 tempest-AttachVolumeNegativeTest-475698259 None] attachment_update completed successfully. Jun 04 21:23:28.124955 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-7f6a6148-5c36-467a-a278-a3942195d809 req-5612be2d-310c-41ca-9b42-ab7a95985f86 tempest-AttachVolumeNegativeTest-475698259 None] Terminate volume connection completed successfully. Jun 04 21:23:28.126236 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-7f6a6148-5c36-467a-a278-a3942195d809 req-5612be2d-310c-41ca-9b42-ab7a95985f86 tempest-AttachVolumeNegativeTest-475698259 None] Deleting attachment 01f2a453-9f14-4ae2-90ec-e9e63f3ce026. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:23:33.812863 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0121d6c7-027a-43c9-8824-29a1524ff93d tempest-AttachVolumeNegativeTest-475698259 None] Lock "b'cinder-fdb6ada6-677b-4f08-acc2-cd8fe9b67249-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:23:33.815804 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:INSERT=4,cinder:SELECT=55,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:33.819014 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=50,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:33.860625 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0121d6c7-027a-43c9-8824-29a1524ff93d tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:33.916177 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0121d6c7-027a-43c9-8824-29a1524ff93d tempest-AttachVolumeNegativeTest-475698259 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:23:33.916734 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0121d6c7-027a-43c9-8824-29a1524ff93d tempest-AttachVolumeNegativeTest-475698259 None] Volume volume-fdb6ada6-677b-4f08-acc2-cd8fe9b67249 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:23:33.932268 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0121d6c7-027a-43c9-8824-29a1524ff93d tempest-AttachVolumeNegativeTest-475698259 None] deleting rbd volume volume-fdb6ada6-677b-4f08-acc2-cd8fe9b67249 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:23:34.321437 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-0121d6c7-027a-43c9-8824-29a1524ff93d tempest-AttachVolumeNegativeTest-475698259 None] Created reservations ['a6209efe-6a0e-4bc0-aff8-d7d03bde48bc', '21ec9190-0e7a-4b5e-9b49-e4b0a6cca2f2', '8e9167d6-29f2-4691-8084-5724a3bd5557', 'd4bfacf5-efe9-4044-ba79-5c9c42551485'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:23:34.388297 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0121d6c7-027a-43c9-8824-29a1524ff93d tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:34.442982 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0121d6c7-027a-43c9-8824-29a1524ff93d tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:34.494106 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0121d6c7-027a-43c9-8824-29a1524ff93d tempest-AttachVolumeNegativeTest-475698259 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:23:34.503852 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0121d6c7-027a-43c9-8824-29a1524ff93d tempest-AttachVolumeNegativeTest-475698259 None] Deleted volume successfully. Jun 04 21:23:34.524340 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-0121d6c7-027a-43c9-8824-29a1524ff93d tempest-AttachVolumeNegativeTest-475698259 None] Lock "b'cinder-fdb6ada6-677b-4f08-acc2-cd8fe9b67249-delete_volume'" released by "delete_volume" :: held 0.712s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:23:35.075711 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-87df5413-be8c-421f-ad4e-9e9605e08fad tempest-AttachVolumeNegativeTest-475698259 None] Lock "b'cinder-98470abe-f55c-4c36-8d51-fc050f6a1e34-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:23:35.120357 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-87df5413-be8c-421f-ad4e-9e9605e08fad tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:35.164703 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-87df5413-be8c-421f-ad4e-9e9605e08fad tempest-AttachVolumeNegativeTest-475698259 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:23:35.165376 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-87df5413-be8c-421f-ad4e-9e9605e08fad tempest-AttachVolumeNegativeTest-475698259 None] Volume volume-98470abe-f55c-4c36-8d51-fc050f6a1e34 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:23:35.172560 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-87df5413-be8c-421f-ad4e-9e9605e08fad tempest-AttachVolumeNegativeTest-475698259 None] deleting rbd volume volume-98470abe-f55c-4c36-8d51-fc050f6a1e34 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:23:35.557310 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-87df5413-be8c-421f-ad4e-9e9605e08fad tempest-AttachVolumeNegativeTest-475698259 None] Created reservations ['9e075e48-5cf6-4079-bff2-6a5452f91aa0', '305478e9-3c07-470d-ad5f-30c7c1e4fd10', '991c4f1a-d758-496c-a069-3986a69d8756', 'f0d57d11-9013-4ac8-8cda-a538fd4a1d9b'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:23:35.632399 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-87df5413-be8c-421f-ad4e-9e9605e08fad tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:35.678828 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-87df5413-be8c-421f-ad4e-9e9605e08fad tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:35.722941 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-87df5413-be8c-421f-ad4e-9e9605e08fad tempest-AttachVolumeNegativeTest-475698259 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:23:35.729501 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-87df5413-be8c-421f-ad4e-9e9605e08fad tempest-AttachVolumeNegativeTest-475698259 None] Deleted volume successfully. Jun 04 21:23:35.746490 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-87df5413-be8c-421f-ad4e-9e9605e08fad tempest-AttachVolumeNegativeTest-475698259 None] Lock "b'cinder-98470abe-f55c-4c36-8d51-fc050f6a1e34-delete_volume'" released by "delete_volume" :: held 0.671s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:23:36.396039 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-47881fae-3963-4f83-b294-4dcf71d6e916 tempest-AttachVolumeNegativeTest-475698259 None] Lock "b'cinder-e55940a4-eed0-4479-8bd9-00bf3d2dd587-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:23:36.436661 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-47881fae-3963-4f83-b294-4dcf71d6e916 tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:36.510178 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-47881fae-3963-4f83-b294-4dcf71d6e916 tempest-AttachVolumeNegativeTest-475698259 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:23:36.510617 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-47881fae-3963-4f83-b294-4dcf71d6e916 tempest-AttachVolumeNegativeTest-475698259 None] Volume volume-e55940a4-eed0-4479-8bd9-00bf3d2dd587 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:23:36.520055 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-47881fae-3963-4f83-b294-4dcf71d6e916 tempest-AttachVolumeNegativeTest-475698259 None] deleting rbd volume volume-e55940a4-eed0-4479-8bd9-00bf3d2dd587 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:23:36.850076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-47881fae-3963-4f83-b294-4dcf71d6e916 tempest-AttachVolumeNegativeTest-475698259 None] Created reservations ['d6abac6a-adae-4343-a302-2d79ec4dd1c5', '3018bd15-0bc1-40b0-80e2-2e745a7e8cf3', '2589ee95-686c-49d6-b9eb-4cedc9859cee', '1b21a4b9-8529-4ed9-99ad-b9f24d93e9fb'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:23:36.896419 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-47881fae-3963-4f83-b294-4dcf71d6e916 tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:36.926778 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-47881fae-3963-4f83-b294-4dcf71d6e916 tempest-AttachVolumeNegativeTest-475698259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:36.968998 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-47881fae-3963-4f83-b294-4dcf71d6e916 tempest-AttachVolumeNegativeTest-475698259 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:23:36.975716 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-47881fae-3963-4f83-b294-4dcf71d6e916 tempest-AttachVolumeNegativeTest-475698259 None] Deleted volume successfully. Jun 04 21:23:36.990355 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-47881fae-3963-4f83-b294-4dcf71d6e916 tempest-AttachVolumeNegativeTest-475698259 None] Lock "b'cinder-e55940a4-eed0-4479-8bd9-00bf3d2dd587-delete_volume'" released by "delete_volume" :: held 0.594s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:23:45.901381 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:23:45.922402 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Flow 'volume_create_manager' (809a28c7-a89b-47d1-947d-52e11572aa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:23:45.928705 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11bb83a-1e14-40be-a2c3-25fa7107b69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:45.946461 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11bb83a-1e14-40be-a2c3-25fa7107b69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-767716130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=83a77b05-5a0a-4985-aeca-138a196ca064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00e14fc13844afdb92a0e9438c28e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:23:46Z,use_quota=True,user_id='49e4cd98e40e46b09692831494b4ece0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:45.951732 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce270683-cf81-47d5-b8a3-6c185541aefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:45.955607 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce270683-cf81-47d5-b8a3-6c185541aefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:45.960729 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8db090e-2c18-45e6-a29e-c9896d5d8a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:46.052865 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8db090e-2c18-45e6-a29e-c9896d5d8a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83a77b05-5a0a-4985-aeca-138a196ca064', 'volume_name': 'volume-83a77b05-5a0a-4985-aeca-138a196ca064', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:46.057545 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00929d93-1cdf-4843-b14c-32a403c09367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:46.061296 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00929d93-1cdf-4843-b14c-32a403c09367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:46.065908 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca78fc30-c05a-402f-bdab-2700b15a7c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:46.067030 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Volume 83a77b05-5a0a-4985-aeca-138a196ca064: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83a77b05-5a0a-4985-aeca-138a196ca064', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:23:46.067792 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Cloning 83a77b05-5a0a-4985-aeca-138a196ca064 from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:23:46.070184 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:23:46.070750 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:46.099689 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:46.126889 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:23:46.141707 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.073s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:23:46.153140 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 23, 46, 146147)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:23:46.153714 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:23:46.154124 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:23:46.159016 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:23:46.160590 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:23:46.165964 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 23, 46, 163731)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:23:46.166369 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:23:46.166753 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:23:46.179051 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:46.244657 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] creating snapshot='volume-83a77b05-5a0a-4985-aeca-138a196ca064.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:23:46.848154 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-83a77b05-5a0a-4985-aeca-138a196ca064.clone_snap' to 'volume-83a77b05-5a0a-4985-aeca-138a196ca064' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:23:47.045914 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:23:47.047167 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:23:47.047939 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:23:47.077737 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:23:47.078468 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Marking volume 83a77b05-5a0a-4985-aeca-138a196ca064 as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:23:47.089826 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 83a77b05-5a0a-4985-aeca-138a196ca064. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:23:47.090308 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Creating volume glance metadata for volume 83a77b05-5a0a-4985-aeca-138a196ca064 backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:23:47.148893 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca78fc30-c05a-402f-bdab-2700b15a7c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a77b05-5a0a-4985-aeca-138a196ca064', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:47.153471 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a0605d-7c22-40aa-a90e-278f9d9c744c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:47.162975 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Volume volume-83a77b05-5a0a-4985-aeca-138a196ca064 (83a77b05-5a0a-4985-aeca-138a196ca064): created successfully Jun 04 21:23:47.166545 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a0605d-7c22-40aa-a90e-278f9d9c744c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:47.172110 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Flow 'volume_create_manager' (809a28c7-a89b-47d1-947d-52e11572aa05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:23:47.180850 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-5b6f37a2-0633-4e37-8615-f1e19f6857ed tempest-VolumesImageMetadata-1011099492 None] Created volume successfully. Jun 04 21:23:48.291482 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] Lock "b'cinder-83a77b05-5a0a-4985-aeca-138a196ca064-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:23:48.336980 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=54,cinder:INSERT=10,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:48.340125 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:48.451544 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:23:48.463361 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] deleting rbd volume volume-83a77b05-5a0a-4985-aeca-138a196ca064 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:23:48.749590 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:23:48.795145 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] deleting parent snapshot volume-83a77b05-5a0a-4985-aeca-138a196ca064.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:23:49.913552 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=61,cinder:UPDATE=23,cinder:INSERT=14,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:49.950895 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] Created reservations ['66057526-d314-4161-bfc2-091139ec0201', 'c410dcfc-aa60-40a9-8281-52aa3c3b6734', 'bd178a3a-864b-404b-b2d9-09ff1be13340', '2593a445-93c0-4377-b45c-ec83dff41925'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:23:50.003247 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:50.031683 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:50.071240 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:23:50.076086 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] Deleted volume successfully. Jun 04 21:23:50.090974 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d0157462-8dc3-45a2-86f2-f606ace97f5a tempest-VolumesImageMetadata-1011099492 None] Lock "b'cinder-83a77b05-5a0a-4985-aeca-138a196ca064-delete_volume'" released by "delete_volume" :: held 1.800s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:23:54.465826 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:23:54.486144 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Flow 'volume_create_manager' (0fbc6489-9233-4120-ae37-78bf06b635ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:23:54.492451 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5387ca24-8497-4ebf-965e-ee16407809e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:54.509070 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5387ca24-8497-4ebf-965e-ee16407809e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1803921204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=56d10924-c386-4fa9-ab63-d28344d861c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704bfcd03a884c3a89a011644bcbf4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:23:54Z,use_quota=True,user_id='52894cd22b0642ee853fa2b53c9e04ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:54.514591 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63106360-a2f8-4c0c-babf-ad746dea6622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:54.518865 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63106360-a2f8-4c0c-babf-ad746dea6622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:54.523968 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63006a68-3931-4aaf-9916-42dd8ad9101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:54.609096 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63006a68-3931-4aaf-9916-42dd8ad9101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56d10924-c386-4fa9-ab63-d28344d861c2', 'volume_name': 'volume-56d10924-c386-4fa9-ab63-d28344d861c2', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:54.614029 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdb5489-9ee7-40c6-bcbf-64289b5ae42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:54.617883 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdb5489-9ee7-40c6-bcbf-64289b5ae42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:54.622290 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bd6379-5c03-4ce3-94c0-08c6bacf7f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:54.623380 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Volume 56d10924-c386-4fa9-ab63-d28344d861c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56d10924-c386-4fa9-ab63-d28344d861c2', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:23:54.623952 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Cloning 56d10924-c386-4fa9-ab63-d28344d861c2 from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:23:54.632127 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:23:54.642853 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 23, 54, 636876)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:23:54.643354 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:23:54.643914 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:23:54.648701 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:23:54.649738 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:23:54.657788 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 23, 54, 655328)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:23:54.658236 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:23:54.658593 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:23:54.670818 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:54.727049 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] creating snapshot='volume-56d10924-c386-4fa9-ab63-d28344d861c2.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:23:55.709111 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-56d10924-c386-4fa9-ab63-d28344d861c2.clone_snap' to 'volume-56d10924-c386-4fa9-ab63-d28344d861c2' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:23:55.859630 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:23:55.860858 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:23:55.861282 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:23:55.883550 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:23:55.884163 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Marking volume 56d10924-c386-4fa9-ab63-d28344d861c2 as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:23:55.895989 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 56d10924-c386-4fa9-ab63-d28344d861c2. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:23:55.896994 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Creating volume glance metadata for volume 56d10924-c386-4fa9-ab63-d28344d861c2 backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:23:55.953070 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bd6379-5c03-4ce3-94c0-08c6bacf7f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d10924-c386-4fa9-ab63-d28344d861c2', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:55.957504 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e22b94-174d-4ba8-ab53-174599f5f4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:55.967619 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Volume volume-56d10924-c386-4fa9-ab63-d28344d861c2 (56d10924-c386-4fa9-ab63-d28344d861c2): created successfully Jun 04 21:23:55.970971 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e22b94-174d-4ba8-ab53-174599f5f4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:55.977091 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Flow 'volume_create_manager' (0fbc6489-9233-4120-ae37-78bf06b635ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:23:55.986451 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a41456a3-07c6-4ef0-8309-dcfe374b0b62 tempest-VolumesCloneTest-1480281008 None] Created volume successfully. Jun 04 21:23:56.880904 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:23:56.923960 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Flow 'volume_create_manager' (2cfdb3d9-6323-4346-9ef3-aa8f33d3170e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:23:56.930181 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cc67db-6e69-4119-a457-ac79aa6c5322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:56.948719 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cc67db-6e69-4119-a457-ac79aa6c5322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-906764265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ac0f146c-65a7-454b-9fbb-19a320c29371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704bfcd03a884c3a89a011644bcbf4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=56d10924-c386-4fa9-ab63-d28344d861c2,status='creating',terminated_at=None,updated_at=2022-06-04T21:23:57Z,use_quota=True,user_id='52894cd22b0642ee853fa2b53c9e04ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:56.954159 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eda49df-80e9-47e5-98c7-d3ec2e2e6eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:56.958316 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eda49df-80e9-47e5-98c7-d3ec2e2e6eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:56.963163 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f1950f-a537-4316-b866-6aac71cd8549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:56.982182 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f1950f-a537-4316-b866-6aac71cd8549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ac0f146c-65a7-454b-9fbb-19a320c29371', 'volume_name': 'volume-ac0f146c-65a7-454b-9fbb-19a320c29371', 'volume_size': 1, 'source_volid': '56d10924-c386-4fa9-ab63-d28344d861c2', 'source_volstatus': 'available'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:56.987336 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabab23c-7733-45ae-a69a-35a991ed5103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:56.992056 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabab23c-7733-45ae-a69a-35a991ed5103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:56.997228 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efae6967-efa1-434d-82e2-db68529d5109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:56.998300 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Volume ac0f146c-65a7-454b-9fbb-19a320c29371: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ac0f146c-65a7-454b-9fbb-19a320c29371', 'volume_size': 1, 'source_volid': '56d10924-c386-4fa9-ab63-d28344d861c2', 'source_volstatus': 'available'} Jun 04 21:23:57.011017 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:57.106606 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] creating snapshot='volume-ac0f146c-65a7-454b-9fbb-19a320c29371.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:23:58.111758 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] cloning 'volume-56d10924-c386-4fa9-ab63-d28344d861c2@volume-ac0f146c-65a7-454b-9fbb-19a320c29371.clone_snap' to 'volume-ac0f146c-65a7-454b-9fbb-19a320c29371' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:23:58.329990 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:23:58.331491 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:23:58.332157 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:23:58.372053 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:23:58.372657 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Marking volume ac0f146c-65a7-454b-9fbb-19a320c29371 as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:23:58.384187 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Copying metadata from source volume 56d10924-c386-4fa9-ab63-d28344d861c2 to ac0f146c-65a7-454b-9fbb-19a320c29371. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}} Jun 04 21:23:58.417127 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efae6967-efa1-434d-82e2-db68529d5109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0f146c-65a7-454b-9fbb-19a320c29371', 'volume_size': 1, 'source_volid': '56d10924-c386-4fa9-ab63-d28344d861c2', 'source_volstatus': 'available'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:58.422063 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9245ca9-4c15-4b92-94d2-1f5570ab59ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:58.434563 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Volume volume-ac0f146c-65a7-454b-9fbb-19a320c29371 (ac0f146c-65a7-454b-9fbb-19a320c29371): created successfully Jun 04 21:23:58.438134 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9245ca9-4c15-4b92-94d2-1f5570ab59ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:58.443901 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Flow 'volume_create_manager' (2cfdb3d9-6323-4346-9ef3-aa8f33d3170e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:23:58.458077 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-271996d8-001a-44bb-a1e3-651d71f4ed23 tempest-VolumesCloneTest-1480281008 None] Created volume successfully. Jun 04 21:23:59.340062 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:23:59.358736 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Flow 'volume_create_manager' (6ae87b0c-e35c-43d0-bc43-21370a9d937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:23:59.364848 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66891c36-6d77-4737-bde7-c4cc3b9f467c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:59.381432 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66891c36-6d77-4737-bde7-c4cc3b9f467c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-858745565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e9031c97-6ac9-481a-a958-33111dd177be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704bfcd03a884c3a89a011644bcbf4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:23:59Z,use_quota=True,user_id='52894cd22b0642ee853fa2b53c9e04ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:59.387066 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efee51f-a986-4101-94d8-9a0d5d0b0938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:59.392063 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efee51f-a986-4101-94d8-9a0d5d0b0938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:59.397167 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498ef524-d153-4a25-adc7-c9726887e0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:59.401159 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498ef524-d153-4a25-adc7-c9726887e0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9031c97-6ac9-481a-a958-33111dd177be', 'volume_name': 'volume-e9031c97-6ac9-481a-a958-33111dd177be', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:59.405745 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6e396d-828e-4510-af30-840c06a04ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:59.409400 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6e396d-828e-4510-af30-840c06a04ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:59.413904 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c07cda6-c87c-4574-8d05-9d7ebffca0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:59.414942 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Volume e9031c97-6ac9-481a-a958-33111dd177be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9031c97-6ac9-481a-a958-33111dd177be', 'volume_size': 1} Jun 04 21:23:59.415319 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] creating volume 'volume-e9031c97-6ac9-481a-a958-33111dd177be' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:23:59.416118 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:23:59.478313 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:23:59.478848 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:23:59.482782 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c07cda6-c87c-4574-8d05-9d7ebffca0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9031c97-6ac9-481a-a958-33111dd177be', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:59.487420 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f68727-7849-415a-a8e4-3fc28410c2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:23:59.498080 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Volume volume-e9031c97-6ac9-481a-a958-33111dd177be (e9031c97-6ac9-481a-a958-33111dd177be): created successfully Jun 04 21:23:59.501714 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f68727-7849-415a-a8e4-3fc28410c2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:23:59.507556 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Flow 'volume_create_manager' (6ae87b0c-e35c-43d0-bc43-21370a9d937e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:23:59.517538 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-776339c5-fcba-471f-8964-0801d6499009 tempest-VolumesCloneTest-1480281008 None] Created volume successfully. Jun 04 21:24:00.715140 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:24:00.742948 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Flow 'volume_create_manager' (fa32cd84-d901-4a79-b666-e89bb537e3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:00.749155 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a82a318-4eed-4411-a226-523e4f9e37fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:00.765866 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a82a318-4eed-4411-a226-523e4f9e37fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1511675310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=748be584-e77c-4253-9838-fd5bae4bf2e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704bfcd03a884c3a89a011644bcbf4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:24:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e9031c97-6ac9-481a-a958-33111dd177be,status='creating',terminated_at=None,updated_at=2022-06-04T21:24:01Z,use_quota=True,user_id='52894cd22b0642ee853fa2b53c9e04ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:00.770857 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc98c318-85f2-4fcf-b2d2-ffa77c1e7f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:00.775249 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc98c318-85f2-4fcf-b2d2-ffa77c1e7f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:00.779996 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2661b9a0-6030-486d-a02c-dc4dbcfdc770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:00.795886 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2661b9a0-6030-486d-a02c-dc4dbcfdc770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '748be584-e77c-4253-9838-fd5bae4bf2e0', 'volume_name': 'volume-748be584-e77c-4253-9838-fd5bae4bf2e0', 'volume_size': 2, 'source_volid': 'e9031c97-6ac9-481a-a958-33111dd177be', 'source_volstatus': 'available'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:00.800307 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1796eac7-1df8-4529-8e74-759f04f85fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:00.804057 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1796eac7-1df8-4529-8e74-759f04f85fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:00.808579 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9d22a6-0dd1-40f6-b0c9-143a9f31c7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:00.809616 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Volume 748be584-e77c-4253-9838-fd5bae4bf2e0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-748be584-e77c-4253-9838-fd5bae4bf2e0', 'volume_size': 2, 'source_volid': 'e9031c97-6ac9-481a-a958-33111dd177be', 'source_volstatus': 'available'} Jun 04 21:24:00.821567 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:00.863967 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] creating snapshot='volume-748be584-e77c-4253-9838-fd5bae4bf2e0.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:24:01.152053 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] cloning 'volume-e9031c97-6ac9-481a-a958-33111dd177be@volume-748be584-e77c-4253-9838-fd5bae4bf2e0.clone_snap' to 'volume-748be584-e77c-4253-9838-fd5bae4bf2e0' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:24:01.250506 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Volume volume-e9031c97-6ac9-481a-a958-33111dd177be is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:24:01.251713 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:24:01.252215 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:24:01.268157 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] resize volume 'volume-748be584-e77c-4253-9838-fd5bae4bf2e0' from 1 to 2 {{(pid=130490) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:749}} Jun 04 21:24:01.268977 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:01.383293 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:24:01.387050 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9d22a6-0dd1-40f6-b0c9-143a9f31c7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748be584-e77c-4253-9838-fd5bae4bf2e0', 'volume_size': 2, 'source_volid': 'e9031c97-6ac9-481a-a958-33111dd177be', 'source_volstatus': 'available'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:01.391904 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338d0c2b-0dd9-496d-a6bb-74020865ed79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:01.401801 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Volume volume-748be584-e77c-4253-9838-fd5bae4bf2e0 (748be584-e77c-4253-9838-fd5bae4bf2e0): created successfully Jun 04 21:24:01.405314 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338d0c2b-0dd9-496d-a6bb-74020865ed79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:01.410783 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Flow 'volume_create_manager' (fa32cd84-d901-4a79-b666-e89bb537e3e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:01.428037 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-6744d255-36d8-492e-912a-1273f0de6c92 tempest-VolumesCloneTest-1480281008 None] Created volume successfully. Jun 04 21:24:01.814918 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] Lock "b'cinder-748be584-e77c-4253-9838-fd5bae4bf2e0-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:01.851726 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:01.914800 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:24:01.923710 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] deleting rbd volume volume-748be584-e77c-4253-9838-fd5bae4bf2e0 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:24:02.156223 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:24:02.180499 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] Volume volume-e9031c97-6ac9-481a-a958-33111dd177be is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:24:02.181183 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] deleting parent snapshot volume-748be584-e77c-4253-9838-fd5bae4bf2e0.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:24:03.222179 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] Created reservations ['8b44c549-e760-4254-9b70-8d5088b4a675', '14c03049-0999-477a-94f0-3637edb90afa', '5bb07e64-ffad-4fba-801f-72bf2485fc67', 'ce9dfbd8-8d88-4498-b7b0-6b58789d4280'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:24:03.289455 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=58,cinder:INSERT=14,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:03.300161 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:03.325307 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:03.349326 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:03.353690 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] Deleted volume successfully. Jun 04 21:24:03.371319 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-60479b30-5128-4005-b083-25be41d003b7 tempest-VolumesCloneTest-1480281008 None] Lock "b'cinder-748be584-e77c-4253-9838-fd5bae4bf2e0-delete_volume'" released by "delete_volume" :: held 1.556s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:04.014569 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-65867cc4-812d-407f-a441-f46ffa931e09 tempest-VolumesCloneTest-1480281008 None] Lock "b'cinder-e9031c97-6ac9-481a-a958-33111dd177be-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:04.049422 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-65867cc4-812d-407f-a441-f46ffa931e09 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:04.096273 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-65867cc4-812d-407f-a441-f46ffa931e09 tempest-VolumesCloneTest-1480281008 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:24:04.096793 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-65867cc4-812d-407f-a441-f46ffa931e09 tempest-VolumesCloneTest-1480281008 None] Volume volume-e9031c97-6ac9-481a-a958-33111dd177be is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:24:04.105774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-65867cc4-812d-407f-a441-f46ffa931e09 tempest-VolumesCloneTest-1480281008 None] deleting rbd volume volume-e9031c97-6ac9-481a-a958-33111dd177be {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:24:04.342182 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=56,cinder:INSERT=18,cinder:UPDATE=23,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:04.374789 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-65867cc4-812d-407f-a441-f46ffa931e09 tempest-VolumesCloneTest-1480281008 None] Created reservations ['1c425adc-10c8-4550-8b1b-d640f97d211f', '0d7ccab7-a634-4f60-b943-1588a97d140c', '833833cd-0534-4f17-8c78-7bea21f665fd', 'e41071a8-179d-4782-aaab-33caab4be6f5'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:24:04.422930 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-65867cc4-812d-407f-a441-f46ffa931e09 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:04.449525 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-65867cc4-812d-407f-a441-f46ffa931e09 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:04.483353 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-65867cc4-812d-407f-a441-f46ffa931e09 tempest-VolumesCloneTest-1480281008 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:04.487411 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-65867cc4-812d-407f-a441-f46ffa931e09 tempest-VolumesCloneTest-1480281008 None] Deleted volume successfully. Jun 04 21:24:04.500536 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-65867cc4-812d-407f-a441-f46ffa931e09 tempest-VolumesCloneTest-1480281008 None] Lock "b'cinder-e9031c97-6ac9-481a-a958-33111dd177be-delete_volume'" released by "delete_volume" :: held 0.486s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:05.153967 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] Lock "b'cinder-ac0f146c-65a7-454b-9fbb-19a320c29371-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:05.194631 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:05.283217 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:24:05.290703 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] deleting rbd volume volume-ac0f146c-65a7-454b-9fbb-19a320c29371 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:24:05.503030 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:24:05.549370 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] deleting parent snapshot volume-ac0f146c-65a7-454b-9fbb-19a320c29371.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:24:06.254115 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] Created reservations ['08d9ca80-db2a-45fd-90d8-9eb60629a6bb', 'c2e5237d-195b-40da-876a-ebd61cff8fa7', 'fd534981-ac68-4712-93cc-e5297666a05d', '0f42b975-1963-478a-92ca-c04d97517c08'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:24:06.301818 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:06.327523 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:06.351452 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:06.355841 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] Deleted volume successfully. Jun 04 21:24:06.374935 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-485a7e30-d8b0-4038-83c8-8b24c8f70174 tempest-VolumesCloneTest-1480281008 None] Lock "b'cinder-ac0f146c-65a7-454b-9fbb-19a320c29371-delete_volume'" released by "delete_volume" :: held 1.221s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:07.380979 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] Lock "b'cinder-56d10924-c386-4fa9-ab63-d28344d861c2-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:07.422579 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:07.492935 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:24:07.501882 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] deleting rbd volume volume-56d10924-c386-4fa9-ab63-d28344d861c2 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:24:07.712365 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:24:07.748768 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] deleting parent snapshot volume-56d10924-c386-4fa9-ab63-d28344d861c2.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:24:08.292739 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] Created reservations ['3b92e981-6e05-4acf-84c0-bdc17856015f', 'a519f06a-8ade-4e8d-aaa4-fe4295ccbc9c', 'd1b76dcd-7ba0-4ac8-9e88-ab80ab0dcc25', '559646af-3588-4adc-8388-66aba902ddc0'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:24:08.343337 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:08.392853 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:08.431880 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:08.437940 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] Deleted volume successfully. Jun 04 21:24:08.455050 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-6e736818-3b43-4d2e-8aab-2b653c2f2b43 tempest-VolumesCloneTest-1480281008 None] Lock "b'cinder-56d10924-c386-4fa9-ab63-d28344d861c2-delete_volume'" released by "delete_volume" :: held 1.074s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:10.359774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:24:10.379394 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (70de2d70-5710-4bfc-ba59-e66f3c2e6747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:10.385537 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cad1ca4-4aca-4348-89ce-96b91099740b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:10.403922 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cad1ca4-4aca-4348-89ce-96b91099740b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1286439755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=824d4746-3f23-4c57-9afc-6e2d2e2f4fde,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e3a0e715b531413fb885be9b4f301f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:24:10Z,use_quota=True,user_id='5fde5b33000144d09e5455986e5c1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:10.409076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09947b6d-67a0-42bd-8758-92355bf2b6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:10.413094 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09947b6d-67a0-42bd-8758-92355bf2b6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:10.418157 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00de4640-5f9e-4e21-9af7-90d35201082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:10.422214 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00de4640-5f9e-4e21-9af7-90d35201082c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '824d4746-3f23-4c57-9afc-6e2d2e2f4fde', 'volume_name': 'volume-824d4746-3f23-4c57-9afc-6e2d2e2f4fde', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:10.427613 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd4fc0c-9e52-4abf-a98d-4d134b6c88df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:10.431826 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd4fc0c-9e52-4abf-a98d-4d134b6c88df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:10.436260 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0935adaf-cb71-43f8-8eaa-69c4eb0b6945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:10.437303 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Volume 824d4746-3f23-4c57-9afc-6e2d2e2f4fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-824d4746-3f23-4c57-9afc-6e2d2e2f4fde', 'volume_size': 1} Jun 04 21:24:10.437686 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] creating volume 'volume-824d4746-3f23-4c57-9afc-6e2d2e2f4fde' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:24:10.438443 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:10.498317 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:24:10.499076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:24:10.502744 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0935adaf-cb71-43f8-8eaa-69c4eb0b6945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824d4746-3f23-4c57-9afc-6e2d2e2f4fde', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:10.507300 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f6b6dd-a967-451a-b4f7-7cabae5ae4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:10.517815 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Volume volume-824d4746-3f23-4c57-9afc-6e2d2e2f4fde (824d4746-3f23-4c57-9afc-6e2d2e2f4fde): created successfully Jun 04 21:24:10.521427 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f6b6dd-a967-451a-b4f7-7cabae5ae4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:10.527346 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (70de2d70-5710-4bfc-ba59-e66f3c2e6747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:10.537528 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-5dd25a7b-610f-468d-b260-1a7b0b31d06d tempest-VolumesGetTest-1337031913 None] Created volume successfully. Jun 04 21:24:11.917716 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:24:11.938177 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (a779dc7b-d2f8-43d9-a8f3-7fa098903f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:11.944686 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776bb15d-3585-4b9a-8bfe-18bbdbe8f3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:11.960903 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776bb15d-3585-4b9a-8bfe-18bbdbe8f3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:24:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1463825702',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=96552ff2-c81c-4ab6-beb2-ef590a68213b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a0e715b531413fb885be9b4f301f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:24:12Z,use_quota=True,user_id='5fde5b33000144d09e5455986e5c1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:11.966629 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b875603-64cf-480e-9cf5-1166d9a2c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:11.970629 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b875603-64cf-480e-9cf5-1166d9a2c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:11.977068 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047017de-2c1b-4667-b234-5c06a339efab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:11.981076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047017de-2c1b-4667-b234-5c06a339efab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96552ff2-c81c-4ab6-beb2-ef590a68213b', 'volume_name': 'volume-96552ff2-c81c-4ab6-beb2-ef590a68213b', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:11.985653 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb70800-9387-439f-b961-c10620b5683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:11.989535 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb70800-9387-439f-b961-c10620b5683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:11.994220 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9563acaf-634a-4658-aac6-3898a3ff9844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:11.995261 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Volume 96552ff2-c81c-4ab6-beb2-ef590a68213b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96552ff2-c81c-4ab6-beb2-ef590a68213b', 'volume_size': 1} Jun 04 21:24:11.995681 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] creating volume 'volume-96552ff2-c81c-4ab6-beb2-ef590a68213b' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:24:11.996314 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:12.064785 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:24:12.065208 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:24:12.069021 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9563acaf-634a-4658-aac6-3898a3ff9844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96552ff2-c81c-4ab6-beb2-ef590a68213b', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:12.073561 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976e9c37-11f6-4afd-be4c-7233a490e5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:12.084571 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Volume volume-96552ff2-c81c-4ab6-beb2-ef590a68213b (96552ff2-c81c-4ab6-beb2-ef590a68213b): created successfully Jun 04 21:24:12.088237 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976e9c37-11f6-4afd-be4c-7233a490e5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:12.093613 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (a779dc7b-d2f8-43d9-a8f3-7fa098903f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:12.103440 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8a6c12b8-daf3-47ba-b0c4-bf4a585bbc4f tempest-VolumesGetTest-1337031913 None] Created volume successfully. Jun 04 21:24:13.241423 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ff95fd0b-3e0d-44d5-9da2-a5d9f91cdecb tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-96552ff2-c81c-4ab6-beb2-ef590a68213b-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:13.276477 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ff95fd0b-3e0d-44d5-9da2-a5d9f91cdecb tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:13.317066 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ff95fd0b-3e0d-44d5-9da2-a5d9f91cdecb tempest-VolumesGetTest-1337031913 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:24:13.317504 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ff95fd0b-3e0d-44d5-9da2-a5d9f91cdecb tempest-VolumesGetTest-1337031913 None] Volume volume-96552ff2-c81c-4ab6-beb2-ef590a68213b is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:24:13.324604 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ff95fd0b-3e0d-44d5-9da2-a5d9f91cdecb tempest-VolumesGetTest-1337031913 None] deleting rbd volume volume-96552ff2-c81c-4ab6-beb2-ef590a68213b {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:24:13.576890 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-ff95fd0b-3e0d-44d5-9da2-a5d9f91cdecb tempest-VolumesGetTest-1337031913 None] Created reservations ['008fcf18-28a9-4895-a361-223be681a7d4', 'f759ae5d-9ea0-4d66-92d9-041fb67e9a0e', '95810ebf-a832-458b-ba54-644f5216b08f', 'ad83e612-d2f9-417e-a6fc-63fc9e1b4977'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:24:13.609057 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=58,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:13.617531 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:INSERT=8,cinder:SELECT=50,cinder:UPDATE=41,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:13.623418 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ff95fd0b-3e0d-44d5-9da2-a5d9f91cdecb tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:13.651894 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-ff95fd0b-3e0d-44d5-9da2-a5d9f91cdecb tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:13.682487 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-ff95fd0b-3e0d-44d5-9da2-a5d9f91cdecb tempest-VolumesGetTest-1337031913 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:13.687490 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-ff95fd0b-3e0d-44d5-9da2-a5d9f91cdecb tempest-VolumesGetTest-1337031913 None] Deleted volume successfully. Jun 04 21:24:13.711156 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-ff95fd0b-3e0d-44d5-9da2-a5d9f91cdecb tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-96552ff2-c81c-4ab6-beb2-ef590a68213b-delete_volume'" released by "delete_volume" :: held 0.470s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:14.399566 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-48533e4f-b9e8-4b0a-9aa9-26608e15512e tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-824d4746-3f23-4c57-9afc-6e2d2e2f4fde-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:14.442736 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-48533e4f-b9e8-4b0a-9aa9-26608e15512e tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:14.486628 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-48533e4f-b9e8-4b0a-9aa9-26608e15512e tempest-VolumesGetTest-1337031913 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:24:14.487127 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-48533e4f-b9e8-4b0a-9aa9-26608e15512e tempest-VolumesGetTest-1337031913 None] Volume volume-824d4746-3f23-4c57-9afc-6e2d2e2f4fde is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:24:14.493517 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-48533e4f-b9e8-4b0a-9aa9-26608e15512e tempest-VolumesGetTest-1337031913 None] deleting rbd volume volume-824d4746-3f23-4c57-9afc-6e2d2e2f4fde {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:24:14.729227 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-48533e4f-b9e8-4b0a-9aa9-26608e15512e tempest-VolumesGetTest-1337031913 None] Created reservations ['8f5c98be-1438-4cb5-8bf3-5af6f7639018', '77557a57-9c5f-4a18-9244-08182feed429', '63593b7d-9150-45b4-8483-0fdefdfddf6b', '123e208b-1469-40be-9eeb-a6d45da21769'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:24:14.774486 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-48533e4f-b9e8-4b0a-9aa9-26608e15512e tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:14.800181 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-48533e4f-b9e8-4b0a-9aa9-26608e15512e tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:14.828930 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-48533e4f-b9e8-4b0a-9aa9-26608e15512e tempest-VolumesGetTest-1337031913 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:14.844850 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-48533e4f-b9e8-4b0a-9aa9-26608e15512e tempest-VolumesGetTest-1337031913 None] Deleted volume successfully. Jun 04 21:24:14.858678 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-48533e4f-b9e8-4b0a-9aa9-26608e15512e tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-824d4746-3f23-4c57-9afc-6e2d2e2f4fde-delete_volume'" released by "delete_volume" :: held 0.459s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:15.866554 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:24:15.885434 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (1e6bcd46-cef9-4004-b8c9-c342e292ca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:15.893204 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677e9eb4-6220-4b59-b244-f71fe5acb6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:15.917489 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677e9eb4-6220-4b59-b244-f71fe5acb6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1402317267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3a42a35-6362-4b65-9cff-49139a0a93dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a0e715b531413fb885be9b4f301f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:24:16Z,use_quota=True,user_id='5fde5b33000144d09e5455986e5c1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:15.924450 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd7cd02-8476-49f9-9808-16188a9ba71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:15.930026 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd7cd02-8476-49f9-9808-16188a9ba71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:15.936944 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58480551-be17-45ec-878b-361e23a21988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:15.939680 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58480551-be17-45ec-878b-361e23a21988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a42a35-6362-4b65-9cff-49139a0a93dd', 'volume_name': 'volume-d3a42a35-6362-4b65-9cff-49139a0a93dd', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:15.944251 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d1786c-9abf-430c-b1fc-03d21720980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:15.948638 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d1786c-9abf-430c-b1fc-03d21720980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:15.953041 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4840c8-e8b3-4fc7-8954-fb28f90401e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:15.954273 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Volume d3a42a35-6362-4b65-9cff-49139a0a93dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a42a35-6362-4b65-9cff-49139a0a93dd', 'volume_size': 1} Jun 04 21:24:15.955629 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] creating volume 'volume-d3a42a35-6362-4b65-9cff-49139a0a93dd' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:24:15.955629 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:16.048683 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:24:16.048993 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:24:16.057503 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4840c8-e8b3-4fc7-8954-fb28f90401e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a42a35-6362-4b65-9cff-49139a0a93dd', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:16.062316 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59cf916-a084-4c34-a740-13382d5ff8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:16.074198 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Volume volume-d3a42a35-6362-4b65-9cff-49139a0a93dd (d3a42a35-6362-4b65-9cff-49139a0a93dd): created successfully Jun 04 21:24:16.077917 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59cf916-a084-4c34-a740-13382d5ff8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:16.084143 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (1e6bcd46-cef9-4004-b8c9-c342e292ca95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:16.098153 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e4a4e118-5b6b-4cc0-a097-2b50e152380b tempest-VolumesGetTest-1337031913 None] Created volume successfully. Jun 04 21:24:17.351466 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:24:17.397430 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (d8b75eeb-f08f-44ea-8a10-c7229b0a28c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:17.404199 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a57b35b-c03c-4c36-b48b-c600301ad141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:17.420954 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a57b35b-c03c-4c36-b48b-c600301ad141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2011988640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=42db8020-bcc0-4248-a864-9c07925986d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e3a0e715b531413fb885be9b4f301f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d3a42a35-6362-4b65-9cff-49139a0a93dd,status='creating',terminated_at=None,updated_at=2022-06-04T21:24:17Z,use_quota=True,user_id='5fde5b33000144d09e5455986e5c1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:17.428232 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3021e2bc-9419-4a7d-8b1f-b06508e439e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:17.434276 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3021e2bc-9419-4a7d-8b1f-b06508e439e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:17.440059 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e122d06-674a-4347-9a4e-107defb82186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:17.456730 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e122d06-674a-4347-9a4e-107defb82186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '42db8020-bcc0-4248-a864-9c07925986d0', 'volume_name': 'volume-42db8020-bcc0-4248-a864-9c07925986d0', 'volume_size': 1, 'source_volid': 'd3a42a35-6362-4b65-9cff-49139a0a93dd', 'source_volstatus': 'available'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:17.461714 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e34d50a-8739-4fea-966d-f483050465a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:17.465625 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e34d50a-8739-4fea-966d-f483050465a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:17.470294 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfbe321-c7a9-48f6-b73d-661bc4925891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:17.472651 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Volume 42db8020-bcc0-4248-a864-9c07925986d0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-42db8020-bcc0-4248-a864-9c07925986d0', 'volume_size': 1, 'source_volid': 'd3a42a35-6362-4b65-9cff-49139a0a93dd', 'source_volstatus': 'available'} Jun 04 21:24:17.486227 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:17.545846 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] creating snapshot='volume-42db8020-bcc0-4248-a864-9c07925986d0.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:24:18.140277 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] cloning 'volume-d3a42a35-6362-4b65-9cff-49139a0a93dd@volume-42db8020-bcc0-4248-a864-9c07925986d0.clone_snap' to 'volume-42db8020-bcc0-4248-a864-9c07925986d0' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:24:18.241989 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Volume volume-d3a42a35-6362-4b65-9cff-49139a0a93dd is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:24:18.243625 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:24:18.244000 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:24:18.269515 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:24:18.274240 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfbe321-c7a9-48f6-b73d-661bc4925891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42db8020-bcc0-4248-a864-9c07925986d0', 'volume_size': 1, 'source_volid': 'd3a42a35-6362-4b65-9cff-49139a0a93dd', 'source_volstatus': 'available'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:18.279004 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bf0057-1d42-4d86-9f37-4fbfeedb362d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:18.290751 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Volume volume-42db8020-bcc0-4248-a864-9c07925986d0 (42db8020-bcc0-4248-a864-9c07925986d0): created successfully Jun 04 21:24:18.294398 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bf0057-1d42-4d86-9f37-4fbfeedb362d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:18.300418 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (d8b75eeb-f08f-44ea-8a10-c7229b0a28c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:18.321019 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b23446e9-4ce0-4558-b7fb-8e07bdf21c68 tempest-VolumesGetTest-1337031913 None] Created volume successfully. Jun 04 21:24:19.098376 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:24:19.130176 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (e7e5adb9-1676-4079-95d5-05c2d830dc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:19.137048 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d2128c-40e0-40e6-9872-ca4606d2802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:19.153235 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d2128c-40e0-40e6-9872-ca4606d2802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:24:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1954946734',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7600926c-a611-4e7e-87cf-073e3c206e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a0e715b531413fb885be9b4f301f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:24:19Z,use_quota=True,user_id='5fde5b33000144d09e5455986e5c1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:19.158363 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36274c2f-3986-41f1-8940-41ad0f6204ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:19.162475 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36274c2f-3986-41f1-8940-41ad0f6204ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:19.168018 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc55d31-cfca-4e01-a9aa-f40b7ff2e398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:19.171952 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc55d31-cfca-4e01-a9aa-f40b7ff2e398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7600926c-a611-4e7e-87cf-073e3c206e3e', 'volume_name': 'volume-7600926c-a611-4e7e-87cf-073e3c206e3e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:19.176813 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5902c69-2bbc-4a6d-90dc-ea1c0956e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:19.180676 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5902c69-2bbc-4a6d-90dc-ea1c0956e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:19.185373 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d0f66c-d5d0-4f7a-ba17-151331a4c643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:19.186437 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Volume 7600926c-a611-4e7e-87cf-073e3c206e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7600926c-a611-4e7e-87cf-073e3c206e3e', 'volume_size': 1} Jun 04 21:24:19.186818 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] creating volume 'volume-7600926c-a611-4e7e-87cf-073e3c206e3e' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:24:19.187453 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:19.266907 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:24:19.267688 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:24:19.271459 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d0f66c-d5d0-4f7a-ba17-151331a4c643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7600926c-a611-4e7e-87cf-073e3c206e3e', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:19.276816 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd38475-7998-401d-b1d8-4e31628e0fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:19.289164 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Volume volume-7600926c-a611-4e7e-87cf-073e3c206e3e (7600926c-a611-4e7e-87cf-073e3c206e3e): created successfully Jun 04 21:24:19.292973 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd38475-7998-401d-b1d8-4e31628e0fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:19.298771 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (e7e5adb9-1676-4079-95d5-05c2d830dc18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:19.311817 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-5d934fa7-0853-4221-b4f1-2aeb8d09b579 tempest-VolumesGetTest-1337031913 None] Created volume successfully. Jun 04 21:24:20.176932 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-696f791d-5640-41ad-b2d4-fb2c0fdd4d25 tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-7600926c-a611-4e7e-87cf-073e3c206e3e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:20.216581 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-696f791d-5640-41ad-b2d4-fb2c0fdd4d25 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:20.258974 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-696f791d-5640-41ad-b2d4-fb2c0fdd4d25 tempest-VolumesGetTest-1337031913 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:24:20.259457 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-696f791d-5640-41ad-b2d4-fb2c0fdd4d25 tempest-VolumesGetTest-1337031913 None] Volume volume-7600926c-a611-4e7e-87cf-073e3c206e3e is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:24:20.265331 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-696f791d-5640-41ad-b2d4-fb2c0fdd4d25 tempest-VolumesGetTest-1337031913 None] deleting rbd volume volume-7600926c-a611-4e7e-87cf-073e3c206e3e {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:24:20.502815 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-696f791d-5640-41ad-b2d4-fb2c0fdd4d25 tempest-VolumesGetTest-1337031913 None] Created reservations ['a356de32-4252-4143-9be4-ad0a50b55fe7', 'e2d2e09c-d71f-4f7f-81c2-05bc21da7343', 'c00cd80a-c47b-432e-abdf-53386d109c34', 'a4a2c9a7-3bbf-4636-a041-1cd6a280b97a'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:24:20.557881 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-696f791d-5640-41ad-b2d4-fb2c0fdd4d25 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:20.606709 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-696f791d-5640-41ad-b2d4-fb2c0fdd4d25 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:20.653636 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-696f791d-5640-41ad-b2d4-fb2c0fdd4d25 tempest-VolumesGetTest-1337031913 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:20.657805 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-696f791d-5640-41ad-b2d4-fb2c0fdd4d25 tempest-VolumesGetTest-1337031913 None] Deleted volume successfully. Jun 04 21:24:20.675117 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-696f791d-5640-41ad-b2d4-fb2c0fdd4d25 tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-7600926c-a611-4e7e-87cf-073e3c206e3e-delete_volume'" released by "delete_volume" :: held 0.498s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:21.320512 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-42db8020-bcc0-4248-a864-9c07925986d0-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:21.393212 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:21.464406 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:24:21.474177 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] deleting rbd volume volume-42db8020-bcc0-4248-a864-9c07925986d0 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:24:21.712046 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:24:21.731645 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] Volume volume-d3a42a35-6362-4b65-9cff-49139a0a93dd is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:24:21.732261 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] deleting parent snapshot volume-42db8020-bcc0-4248-a864-9c07925986d0.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:24:22.228958 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] Created reservations ['d01d95f3-4093-4a17-bff7-09460db41b9f', '4ff2b771-4117-4d12-a63e-4187017bfb92', 'c2994c88-6183-4306-945b-096a506ec42a', '2cbb8069-5cf9-4d6e-923f-a470c57b659f'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:24:22.272860 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=60,cinder:DELETE=3,cinder:UPDATE=32,cinder:INSERT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:22.279250 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:22.303651 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:22.332338 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:22.337123 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] Deleted volume successfully. Jun 04 21:24:22.351748 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-db5d9a2e-0261-4875-aec8-b85deda7c356 tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-42db8020-bcc0-4248-a864-9c07925986d0-delete_volume'" released by "delete_volume" :: held 1.031s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:22.869968 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:24:22.889733 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (f5132881-42e8-4014-a4da-695cd48aa72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:22.895948 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a8672b-0efb-4b32-aca0-5e4ed16cd330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:22.913531 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a8672b-0efb-4b32-aca0-5e4ed16cd330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-405844781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3587768-2ca6-4562-ad44-007d069d9b33,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e3a0e715b531413fb885be9b4f301f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:24:23Z,use_quota=True,user_id='5fde5b33000144d09e5455986e5c1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:22.918800 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a36638-5f5c-4ab1-9de4-9618dc372bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:22.923057 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a36638-5f5c-4ab1-9de4-9618dc372bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:22.927545 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3231f3d5-94f0-49a3-9232-50cf8e61b7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:23.009923 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3231f3d5-94f0-49a3-9232-50cf8e61b7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3587768-2ca6-4562-ad44-007d069d9b33', 'volume_name': 'volume-d3587768-2ca6-4562-ad44-007d069d9b33', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:23.016564 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076e3587-7081-4335-a36d-5365a9c24886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:23.019740 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076e3587-7081-4335-a36d-5365a9c24886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:23.024257 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6ffdfc-8f31-4398-8cd5-327f8e30a2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:23.025382 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Volume d3587768-2ca6-4562-ad44-007d069d9b33: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3587768-2ca6-4562-ad44-007d069d9b33', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:24:23.025931 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Cloning d3587768-2ca6-4562-ad44-007d069d9b33 from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:24:23.034990 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:23.045357 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 24, 23, 39055)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:24:23.045776 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:24:23.046171 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:24:23.050670 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:23.051516 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:24:23.057955 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 24, 23, 55188)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:24:23.058372 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:24:23.058753 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:24:23.070612 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:23.125918 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] creating snapshot='volume-d3587768-2ca6-4562-ad44-007d069d9b33.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:24:23.221010 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-d3587768-2ca6-4562-ad44-007d069d9b33.clone_snap' to 'volume-d3587768-2ca6-4562-ad44-007d069d9b33' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:24:23.359120 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:24:23.365737 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:24:23.366131 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:24:23.402404 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:24:23.403013 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Marking volume d3587768-2ca6-4562-ad44-007d069d9b33 as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:24:23.414601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to d3587768-2ca6-4562-ad44-007d069d9b33. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:24:23.415390 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Creating volume glance metadata for volume d3587768-2ca6-4562-ad44-007d069d9b33 backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:24:23.459103 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=54,cinder:INSERT=14,cinder:UPDATE=28,cinder:DELETE=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:23.475207 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6ffdfc-8f31-4398-8cd5-327f8e30a2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3587768-2ca6-4562-ad44-007d069d9b33', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:23.480152 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644f7a31-c1d8-4ad7-b7c8-b0bd8bc22669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:23.492183 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Volume volume-d3587768-2ca6-4562-ad44-007d069d9b33 (d3587768-2ca6-4562-ad44-007d069d9b33): created successfully Jun 04 21:24:23.496176 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644f7a31-c1d8-4ad7-b7c8-b0bd8bc22669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:23.501504 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (f5132881-42e8-4014-a4da-695cd48aa72d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:23.510767 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b2f423ec-ae4f-4e6c-93fa-211ccfc33067 tempest-VolumesGetTest-1337031913 None] Created volume successfully. Jun 04 21:24:24.430163 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:24:24.452975 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (f42b4c76-c9c3-4f02-ba14-0e5686e7d9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:24.458933 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9f5c74-f0a5-4264-86f4-64e95c802005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:24.474804 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9f5c74-f0a5-4264-86f4-64e95c802005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:24:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1180188195',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=76aac987-9d37-4b87-9cef-29a1fedad346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a0e715b531413fb885be9b4f301f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:24:24Z,use_quota=True,user_id='5fde5b33000144d09e5455986e5c1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:24.480319 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ade71a1-6ba3-49bf-a6c4-307581741e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:24.484251 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ade71a1-6ba3-49bf-a6c4-307581741e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:24.488974 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd17fc87-499d-487e-9f62-948886573801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:24.493341 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd17fc87-499d-487e-9f62-948886573801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76aac987-9d37-4b87-9cef-29a1fedad346', 'volume_name': 'volume-76aac987-9d37-4b87-9cef-29a1fedad346', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:24.497855 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af5cf68-28e0-4336-8ea1-d7ca0eadb302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:24.501511 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af5cf68-28e0-4336-8ea1-d7ca0eadb302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:24.505896 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde3d57b-cefb-4d58-8e03-51cd29e08608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:24.506922 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Volume 76aac987-9d37-4b87-9cef-29a1fedad346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76aac987-9d37-4b87-9cef-29a1fedad346', 'volume_size': 1} Jun 04 21:24:24.507304 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] creating volume 'volume-76aac987-9d37-4b87-9cef-29a1fedad346' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:24:24.508073 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:24.568463 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:24:24.568750 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:24:24.572536 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde3d57b-cefb-4d58-8e03-51cd29e08608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76aac987-9d37-4b87-9cef-29a1fedad346', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:24.576947 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3946b9-d160-45a2-97f2-b8f1baab9bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:24.588018 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Volume volume-76aac987-9d37-4b87-9cef-29a1fedad346 (76aac987-9d37-4b87-9cef-29a1fedad346): created successfully Jun 04 21:24:24.591717 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3946b9-d160-45a2-97f2-b8f1baab9bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:24.597018 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Flow 'volume_create_manager' (f42b4c76-c9c3-4f02-ba14-0e5686e7d9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:24.607089 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b0615b9c-3d83-4309-af03-aba0ff75a3eb tempest-VolumesGetTest-1337031913 None] Created volume successfully. Jun 04 21:24:25.546519 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-846333ef-68a4-4e87-ba4e-8f7572868c5c tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-76aac987-9d37-4b87-9cef-29a1fedad346-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:25.590247 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-846333ef-68a4-4e87-ba4e-8f7572868c5c tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:25.631687 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-846333ef-68a4-4e87-ba4e-8f7572868c5c tempest-VolumesGetTest-1337031913 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:24:25.632138 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-846333ef-68a4-4e87-ba4e-8f7572868c5c tempest-VolumesGetTest-1337031913 None] Volume volume-76aac987-9d37-4b87-9cef-29a1fedad346 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:24:25.640771 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-846333ef-68a4-4e87-ba4e-8f7572868c5c tempest-VolumesGetTest-1337031913 None] deleting rbd volume volume-76aac987-9d37-4b87-9cef-29a1fedad346 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:24:25.860245 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-846333ef-68a4-4e87-ba4e-8f7572868c5c tempest-VolumesGetTest-1337031913 None] Created reservations ['8f3453a0-7999-4e79-ac0d-d73703335f4d', '384e8269-638a-43d5-914b-aafec89bc3d3', 'ee2e7634-305a-47b5-bc64-316a49478a6a', '22a82f8f-23fb-4bfd-ab5d-eef8312bc248'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:24:25.908863 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-846333ef-68a4-4e87-ba4e-8f7572868c5c tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:25.942803 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-846333ef-68a4-4e87-ba4e-8f7572868c5c tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:25.979966 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-846333ef-68a4-4e87-ba4e-8f7572868c5c tempest-VolumesGetTest-1337031913 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:25.984141 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-846333ef-68a4-4e87-ba4e-8f7572868c5c tempest-VolumesGetTest-1337031913 None] Deleted volume successfully. Jun 04 21:24:25.998416 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-846333ef-68a4-4e87-ba4e-8f7572868c5c tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-76aac987-9d37-4b87-9cef-29a1fedad346-delete_volume'" released by "delete_volume" :: held 0.452s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:26.700552 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-d3587768-2ca6-4562-ad44-007d069d9b33-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:26.736424 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:26.803020 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:24:26.811859 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] deleting rbd volume volume-d3587768-2ca6-4562-ad44-007d069d9b33 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:24:27.019043 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:24:27.057090 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] deleting parent snapshot volume-d3587768-2ca6-4562-ad44-007d069d9b33.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:24:28.189698 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] Created reservations ['3fb3c42f-ba58-4754-813d-fa83a7a68b7a', '3c021f2b-3651-46b0-893b-6e6f539b1f0a', '1a6fe713-95d8-4ba5-9a2c-7acc7f79064b', 'd009c6fd-7132-452f-8bfe-8854a945c448'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:24:28.237259 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:28.265492 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:28.291545 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:28.295579 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] Deleted volume successfully. Jun 04 21:24:28.309758 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3f0075a1-4ef8-4c6a-91f7-6b8a7d918bd7 tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-d3587768-2ca6-4562-ad44-007d069d9b33-delete_volume'" released by "delete_volume" :: held 1.609s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:28.896166 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-4230d389-bd22-44c9-9d09-892420470e58 tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-d3a42a35-6362-4b65-9cff-49139a0a93dd-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:24:28.929673 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4230d389-bd22-44c9-9d09-892420470e58 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:28.972808 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4230d389-bd22-44c9-9d09-892420470e58 tempest-VolumesGetTest-1337031913 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:24:28.973233 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4230d389-bd22-44c9-9d09-892420470e58 tempest-VolumesGetTest-1337031913 None] Volume volume-d3a42a35-6362-4b65-9cff-49139a0a93dd is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:24:28.979494 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4230d389-bd22-44c9-9d09-892420470e58 tempest-VolumesGetTest-1337031913 None] deleting rbd volume volume-d3a42a35-6362-4b65-9cff-49139a0a93dd {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:24:29.248725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-4230d389-bd22-44c9-9d09-892420470e58 tempest-VolumesGetTest-1337031913 None] Created reservations ['dd4c0acc-1e00-42dc-9419-11b20f360e87', 'd3b93925-8856-457f-b751-c1f5d62fdece', '4a75d59a-07db-44f1-9939-434164bd6c2c', '661e8d24-91ea-4348-a9c7-7adf52e4644c'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:24:29.282896 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=59,cinder:UPDATE=26,cinder:INSERT=12,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:29.296546 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4230d389-bd22-44c9-9d09-892420470e58 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:29.322291 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4230d389-bd22-44c9-9d09-892420470e58 tempest-VolumesGetTest-1337031913 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:29.348670 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-4230d389-bd22-44c9-9d09-892420470e58 tempest-VolumesGetTest-1337031913 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:29.352995 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4230d389-bd22-44c9-9d09-892420470e58 tempest-VolumesGetTest-1337031913 None] Deleted volume successfully. Jun 04 21:24:29.377217 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-4230d389-bd22-44c9-9d09-892420470e58 tempest-VolumesGetTest-1337031913 None] Lock "b'cinder-d3a42a35-6362-4b65-9cff-49139a0a93dd-delete_volume'" released by "delete_volume" :: held 0.481s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:24:29.673504 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-858981fd-43c0-48e9-9008-92f113a2a999 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:30.270704 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-858981fd-43c0-48e9-9008-92f113a2a999 tempest-TestVolumeBootPattern-524389578 None] Create snapshot completed successfully Jun 04 21:24:30.274561 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=53,cinder:UPDATE=32,cinder:INSERT=12,cinder:DELETE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:31.284789 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:24:31.320389 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (2a300fdb-53b4-42e7-8344-6fa1fd7c54c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:31.327028 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e5562c-2b8a-461e-919c-6686df7c7b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:31.351574 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e5562c-2b8a-461e-919c-6686df7c7b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1160563230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cf8fbba4-3ff5-451e-9e8c-477486db525d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6af5f33fb64a17906872b7edb1e049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67e9b32e-203e-4106-b03a-44c9c02a8785,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:24:31Z,use_quota=True,user_id='2356361a22724a45a9213f5b1b4b71fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:31.360818 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4603b875-99e9-47c9-a7b9-7030b78a1952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:31.371248 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4603b875-99e9-47c9-a7b9-7030b78a1952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:31.377812 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1beefb4-73db-483e-b1d7-b51ced38fc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:31.382794 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1beefb4-73db-483e-b1d7-b51ced38fc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf8fbba4-3ff5-451e-9e8c-477486db525d', 'volume_name': 'volume-cf8fbba4-3ff5-451e-9e8c-477486db525d', 'volume_size': 1, 'snapshot_id': '67e9b32e-203e-4106-b03a-44c9c02a8785'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:31.394823 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175a4d84-b400-4f1c-813d-5c4a107da504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:31.398682 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175a4d84-b400-4f1c-813d-5c4a107da504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:31.407210 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5c3f02-8c4f-49e9-90fd-25bebd48b858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:31.408672 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Volume cf8fbba4-3ff5-451e-9e8c-477486db525d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf8fbba4-3ff5-451e-9e8c-477486db525d', 'volume_size': 1, 'snapshot_id': '67e9b32e-203e-4106-b03a-44c9c02a8785'} Jun 04 21:24:31.438864 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] cloning volumes/volume-6121e434-b2b6-4783-9a4b-90d85dc648ef@snapshot-67e9b32e-203e-4106-b03a-44c9c02a8785 to volume-cf8fbba4-3ff5-451e-9e8c-477486db525d {{(pid=130490) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} Jun 04 21:24:31.439917 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:31.532747 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:31.746942 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:24:31.747424 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:24:31.784022 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Marking volume cf8fbba4-3ff5-451e-9e8c-477486db525d as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:24:31.796679 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Copying metadata from snapshot 67e9b32e-203e-4106-b03a-44c9c02a8785 to cf8fbba4-3ff5-451e-9e8c-477486db525d. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jun 04 21:24:31.843590 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5c3f02-8c4f-49e9-90fd-25bebd48b858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8fbba4-3ff5-451e-9e8c-477486db525d', 'volume_size': 1, 'snapshot_id': '67e9b32e-203e-4106-b03a-44c9c02a8785'}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:31.849687 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ca5aa6-cde5-40b7-9e02-ad4dfea62cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:24:31.862712 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Volume volume-cf8fbba4-3ff5-451e-9e8c-477486db525d (cf8fbba4-3ff5-451e-9e8c-477486db525d): created successfully Jun 04 21:24:31.873052 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ca5aa6-cde5-40b7-9e02-ad4dfea62cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:24:31.878796 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Flow 'volume_create_manager' (2a300fdb-53b4-42e7-8344-6fa1fd7c54c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:24:31.895749 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c0c76beb-9285-4b34-bb90-62115add4d2b tempest-TestVolumeBootPattern-524389578 None] Created volume successfully. Jun 04 21:24:35.106345 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-2499d773-ec6c-45ea-a4e8-279328a73a45 req-8446033f-5c4a-4a2f-a5ce-747a29baa3c9 tempest-TestVolumeBootPattern-524389578 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:24:35.798677 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-2499d773-ec6c-45ea-a4e8-279328a73a45 req-8446033f-5c4a-4a2f-a5ce-747a29baa3c9 tempest-TestVolumeBootPattern-524389578 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.691s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:24:35.799572 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-2499d773-ec6c-45ea-a4e8-279328a73a45 req-8446033f-5c4a-4a2f-a5ce-747a29baa3c9 tempest-TestVolumeBootPattern-524389578 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cf8fbba4-3ff5-451e-9e8c-477486db525d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': 'cf8fbba4-3ff5-451e-9e8c-477486db525d', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:24:35.842954 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-2499d773-ec6c-45ea-a4e8-279328a73a45 req-8446033f-5c4a-4a2f-a5ce-747a29baa3c9 tempest-TestVolumeBootPattern-524389578 None] Connection info returned from driver {'name': 'volumes/volume-cf8fbba4-3ff5-451e-9e8c-477486db525d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cf8fbba4-3ff5-451e-9e8c-477486db525d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ac4ead07-33e1-4817-99b9-107d07715ec0'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:24:35.922658 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-2499d773-ec6c-45ea-a4e8-279328a73a45 req-8446033f-5c4a-4a2f-a5ce-747a29baa3c9 tempest-TestVolumeBootPattern-524389578 None] attachment_update completed successfully. Jun 04 21:24:46.074800 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:24:46.075817 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:46.141306 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:24:46.215828 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:24:46.223086 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=25,cinder:UPDATE=4,cinder:INSERT=9,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:06.225754 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=35,cinder:INSERT=8,cinder:UPDATE=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:16.939725 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-191778ef-17b4-4b3b-afbe-fabf41e259a0 tempest-BackendsCapabilitiesAdminTestsJSON-995074558 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:0cd88407-50fe-40f1-b36a-024c7a53e9bf:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=130490) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4737}} Jun 04 21:25:16.976910 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-ea41efc8-3a34-43a1-bce5-087418bf049b tempest-BackendsCapabilitiesAdminTestsJSON-995074558 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:0cd88407-50fe-40f1-b36a-024c7a53e9bf:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=130490) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4737}} Jun 04 21:25:20.168294 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:20.174981 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3a9ed495-705b-490a-810f-d1d2c908751c tempest-GroupsTest-1700455773 None] Group tempest-Group1-1561117274: creating Jun 04 21:25:20.193367 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3a9ed495-705b-490a-810f-d1d2c908751c tempest-GroupsTest-1700455773 None] Group tempest-Group1-1561117274: created successfully Jun 04 21:25:20.203226 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3a9ed495-705b-490a-810f-d1d2c908751c tempest-GroupsTest-1700455773 None] Create group completed successfully. Jun 04 21:25:21.354076 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0e2161d5-f883-484f-a804-f33d98f75563 tempest-GroupsTest-1700455773 None] Group tempest-Group2-565410735: creating Jun 04 21:25:21.374385 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0e2161d5-f883-484f-a804-f33d98f75563 tempest-GroupsTest-1700455773 None] Group tempest-Group2-565410735: created successfully Jun 04 21:25:21.384027 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-0e2161d5-f883-484f-a804-f33d98f75563 tempest-GroupsTest-1700455773 None] Create group completed successfully. Jun 04 21:25:22.782546 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:25:22.812076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Flow 'volume_create_manager' (dfb16788-cb2b-4d47-bfc7-d35d7fd78f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:25:22.818203 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d4ef8f-4531-4c1a-ac5c-24408ee4bd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:22.835319 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d4ef8f-4531-4c1a-ac5c-24408ee4bd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-116215761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1207c003-2d29-4632-a5c8-687be9f07a63,host='ncdv-master-1@ceph#ceph',id=26c2f060-70b1-4594-b531-23eaf8fa3c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9168cbf2600049e4a1fa2acc0072477f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:25:23Z,use_quota=True,user_id='92d327337ecb4f5395eac629f6416c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(272c6cd0-b95b-4f63-a051-9bb1edc86e0d),volume_type_id=272c6cd0-b95b-4f63-a051-9bb1edc86e0d)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:22.840601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4ed918-7653-44bd-9d5f-cbd572ce64cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:22.844476 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4ed918-7653-44bd-9d5f-cbd572ce64cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:22.849210 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48ff36a-7410-4959-b4db-68fdeeafad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:22.853093 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48ff36a-7410-4959-b4db-68fdeeafad38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c2f060-70b1-4594-b531-23eaf8fa3c5d', 'volume_name': 'volume-26c2f060-70b1-4594-b531-23eaf8fa3c5d', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:22.857715 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3182476-1ece-49ea-b233-38bba012f374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:22.861380 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3182476-1ece-49ea-b233-38bba012f374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:22.865798 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f571fd2f-59b6-4d4d-af3e-a37de0494ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:22.866855 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Volume 26c2f060-70b1-4594-b531-23eaf8fa3c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c2f060-70b1-4594-b531-23eaf8fa3c5d', 'volume_size': 1} Jun 04 21:25:22.867236 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] creating volume 'volume-26c2f060-70b1-4594-b531-23eaf8fa3c5d' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:25:22.867890 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:22.934457 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:25:22.934826 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:25:22.938481 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f571fd2f-59b6-4d4d-af3e-a37de0494ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c2f060-70b1-4594-b531-23eaf8fa3c5d', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:22.942943 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8e2a38-8a5a-4c4c-8bee-7010c230fd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:22.954471 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Volume volume-26c2f060-70b1-4594-b531-23eaf8fa3c5d (26c2f060-70b1-4594-b531-23eaf8fa3c5d): created successfully Jun 04 21:25:22.957888 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8e2a38-8a5a-4c4c-8bee-7010c230fd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:22.963201 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Flow 'volume_create_manager' (dfb16788-cb2b-4d47-bfc7-d35d7fd78f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:25:22.973786 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-c1beaac0-a7ce-44bc-a28e-c4a0f988b86c tempest-GroupsTest-1700455773 None] Created volume successfully. Jun 04 21:25:24.285561 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:24.335745 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:25:24.336291 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] Volume volume-26c2f060-70b1-4594-b531-23eaf8fa3c5d is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:25:24.345131 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] deleting rbd volume volume-26c2f060-70b1-4594-b531-23eaf8fa3c5d {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:25:24.611103 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] Created reservations ['e5c1cd48-7b60-4a6d-bdee-4e30269a750d'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:25:24.629312 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1480947762 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1480947762, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:25:24.630073 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1480947762 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1480947762, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:25:24.646313 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] Created reservations ['e13c49a8-1034-474e-8481-ee36323da651', '904b102d-375e-4cf1-9d07-02a6251df93e', '02951d11-9d0a-48b3-b856-232bbd2c5063', 'f02f7cfd-ffcb-4552-a70f-edac01461d50'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:25:24.746242 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:24.768995 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:24.792392 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:25:24.796376 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e5fd4b71-cd6e-45bf-b278-df46d9b0ff5d tempest-GroupsTest-1700455773 None] Delete group completed successfully. Jun 04 21:25:25.501582 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-5d7ea6ba-7a3b-4f52-add0-96404e7c96da tempest-GroupsTest-1700455773 None] Created reservations ['34b88135-fd6a-4e49-8ce0-4dcc719b95c1'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:25:25.538391 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5d7ea6ba-7a3b-4f52-add0-96404e7c96da tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:25.566553 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-5d7ea6ba-7a3b-4f52-add0-96404e7c96da tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:25.593553 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-5d7ea6ba-7a3b-4f52-add0-96404e7c96da tempest-GroupsTest-1700455773 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:25:25.597330 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-5d7ea6ba-7a3b-4f52-add0-96404e7c96da tempest-GroupsTest-1700455773 None] Delete group completed successfully. Jun 04 21:25:26.978550 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9c4bbacd-b075-4e2a-8bde-afa99a459a86 tempest-GroupsTest-1700455773 None] Group tempest-GroupsTest-Group-93557508: creating Jun 04 21:25:26.998540 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9c4bbacd-b075-4e2a-8bde-afa99a459a86 tempest-GroupsTest-1700455773 None] Group tempest-GroupsTest-Group-93557508: created successfully Jun 04 21:25:27.008061 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9c4bbacd-b075-4e2a-8bde-afa99a459a86 tempest-GroupsTest-1700455773 None] Create group completed successfully. Jun 04 21:25:28.406256 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:25:28.425628 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Flow 'volume_create_manager' (e1c93ec9-3d63-457b-908d-ce03335c3e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:25:28.432171 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50180aa9-a868-46ec-9c35-5c14d0722437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:28.448240 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50180aa9-a868-46ec-9c35-5c14d0722437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-474725162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5506c21b-b64f-4d8b-8c75-689fad125f61,host='ncdv-master-1@ceph#ceph',id=408a4490-4d19-4cef-8169-6cd9a252aa7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9168cbf2600049e4a1fa2acc0072477f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:25:28Z,use_quota=True,user_id='92d327337ecb4f5395eac629f6416c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0441354-b12e-4365-890e-3c9f7570eaaa),volume_type_id=e0441354-b12e-4365-890e-3c9f7570eaaa)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:28.453734 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b06fab2-952c-4398-a807-66a95c18d269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:28.457631 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b06fab2-952c-4398-a807-66a95c18d269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:28.462371 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff83831-cca8-4d48-ace6-47ab3855a0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:28.466314 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff83831-cca8-4d48-ace6-47ab3855a0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408a4490-4d19-4cef-8169-6cd9a252aa7b', 'volume_name': 'volume-408a4490-4d19-4cef-8169-6cd9a252aa7b', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:28.471171 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bc5626-9917-4d54-a07b-ec01d7a43bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:28.474857 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bc5626-9917-4d54-a07b-ec01d7a43bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:28.479289 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b274f3-5818-4e7f-bc88-fc382c5ac594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:28.480393 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Volume 408a4490-4d19-4cef-8169-6cd9a252aa7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408a4490-4d19-4cef-8169-6cd9a252aa7b', 'volume_size': 1} Jun 04 21:25:28.480774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] creating volume 'volume-408a4490-4d19-4cef-8169-6cd9a252aa7b' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:25:28.481516 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:28.545613 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:25:28.546050 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:25:28.549829 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b274f3-5818-4e7f-bc88-fc382c5ac594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408a4490-4d19-4cef-8169-6cd9a252aa7b', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:28.554165 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6ea3b4-7a15-4fe5-be36-ee6c1ddad1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:28.565906 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Volume volume-408a4490-4d19-4cef-8169-6cd9a252aa7b (408a4490-4d19-4cef-8169-6cd9a252aa7b): created successfully Jun 04 21:25:28.569708 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6ea3b4-7a15-4fe5-be36-ee6c1ddad1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:28.575346 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Flow 'volume_create_manager' (e1c93ec9-3d63-457b-908d-ce03335c3e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:25:28.593193 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-be931014-3503-44f6-adc1-de4ee9c82788 tempest-GroupsTest-1700455773 None] Created volume successfully. Jun 04 21:25:29.830404 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:25:29.850465 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Flow 'volume_create_manager' (cf5108e6-00a2-45dc-8c5f-3513a32c3b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:25:29.856697 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89171445-446a-4d08-9470-2a62cc4798b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:29.873985 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89171445-446a-4d08-9470-2a62cc4798b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-433665055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5506c21b-b64f-4d8b-8c75-689fad125f61,host='ncdv-master-1@ceph#ceph',id=76c51b1b-010f-4248-a7b8-f586ba86ea00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9168cbf2600049e4a1fa2acc0072477f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:25:30Z,use_quota=True,user_id='92d327337ecb4f5395eac629f6416c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0441354-b12e-4365-890e-3c9f7570eaaa),volume_type_id=e0441354-b12e-4365-890e-3c9f7570eaaa)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:29.879130 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73f05f5-2781-4366-b804-fef1333facb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:29.883076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73f05f5-2781-4366-b804-fef1333facb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:29.887864 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3884c8-0cdb-4889-b7b4-f012737ab164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:29.892401 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3884c8-0cdb-4889-b7b4-f012737ab164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c51b1b-010f-4248-a7b8-f586ba86ea00', 'volume_name': 'volume-76c51b1b-010f-4248-a7b8-f586ba86ea00', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:29.897099 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bcd9da-483f-4a4a-9344-3afb3f47a79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:29.900796 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bcd9da-483f-4a4a-9344-3afb3f47a79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:29.905244 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd921003-e065-4d2d-8d73-cafc1004f668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:29.906337 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Volume 76c51b1b-010f-4248-a7b8-f586ba86ea00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c51b1b-010f-4248-a7b8-f586ba86ea00', 'volume_size': 1} Jun 04 21:25:29.906722 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] creating volume 'volume-76c51b1b-010f-4248-a7b8-f586ba86ea00' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:25:29.907354 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:29.967755 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] extra_specs: {} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:25:29.968072 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] extra_specs: {} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:25:29.972126 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd921003-e065-4d2d-8d73-cafc1004f668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c51b1b-010f-4248-a7b8-f586ba86ea00', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:29.976382 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f9fa3e-e3aa-481a-a7bb-23b1a66e3219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:29.986051 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Volume volume-76c51b1b-010f-4248-a7b8-f586ba86ea00 (76c51b1b-010f-4248-a7b8-f586ba86ea00): created successfully Jun 04 21:25:29.989528 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f9fa3e-e3aa-481a-a7bb-23b1a66e3219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:29.994661 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Flow 'volume_create_manager' (cf5108e6-00a2-45dc-8c5f-3513a32c3b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:25:30.003395 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8de36801-7bd4-4207-9c84-c73c83a94c65 tempest-GroupsTest-1700455773 None] Created volume successfully. Jun 04 21:25:31.017345 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-bb290d2d-0853-4cbe-91af-bd9c79482002 tempest-GroupsTest-1700455773 None] Update group completed successfully. Jun 04 21:25:32.449118 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=66,cinder:UPDATE=29,cinder:INSERT=3,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:32.463948 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-a5a2d089-96f2-4278-a5d5-017d80918202 tempest-GroupsTest-1700455773 None] Update group completed successfully. Jun 04 21:25:34.014049 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:34.094668 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:25:34.095451 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] Volume volume-408a4490-4d19-4cef-8169-6cd9a252aa7b is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:25:34.122495 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] deleting rbd volume volume-408a4490-4d19-4cef-8169-6cd9a252aa7b {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:25:34.410186 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:34.470302 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:25:34.471070 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] Volume volume-76c51b1b-010f-4248-a7b8-f586ba86ea00 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:25:34.480832 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] deleting rbd volume volume-76c51b1b-010f-4248-a7b8-f586ba86ea00 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:25:34.864931 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] Created reservations ['f5e80eee-26ec-4a2b-aa0c-2a7389a025ae'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:25:34.890489 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-927291294 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-927291294, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:25:34.891357 ncdv-master-1 cinder-volume[130490]: WARNING cinder.quota [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-927291294 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-927291294, it is now deprecated. Please use the default quota class for default quota. Jun 04 21:25:34.895164 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=76,cinder:UPDATE=20,cinder:DELETE=1,cinder:INSERT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:34.915001 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] Created reservations ['e8cb3050-4888-4a0a-bd89-a074bb091ed6', 'a0062494-4705-4abc-85c1-b9f7e55fd371', 'f38b4c7c-8932-4df6-8024-6993e8c5e895', 'ea261c32-8bcf-45b8-b2b0-2158cc8ff598'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:25:35.018348 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] Created reservations ['8d3a4e55-e2fa-4258-92ac-d70ab2219f2d', '1ddf06eb-20de-48f9-92e8-1da729906bba', '50af0136-6926-4cd9-a05b-4b70426df3db', 'cabff170-0ef6-44ba-8912-ab3805b4cf50'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:25:35.136366 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:35.203794 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:35.266768 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:25:35.272189 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-60544383-6451-4881-8be2-a8d465b44304 tempest-GroupsTest-1700455773 None] Delete group completed successfully. Jun 04 21:25:46.078035 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:25:46.078769 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:46.105617 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:46.157790 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:25:46.241972 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=18,cinder:SELECT=16,cinder:INSERT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:56.244348 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=29,cinder:UPDATE=19,cinder:INSERT=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:58.146367 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:25:58.166775 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Flow 'volume_create_manager' (88043831-c161-4d3f-bdf4-a621c65c5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:25:58.174601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8bf307-6a48-406b-8f5d-c70fedc55fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:58.192046 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8bf307-6a48-406b-8f5d-c70fedc55fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-987404381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=905727c9-67f4-4ef4-bd5a-b573223ada99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d905982a934fbcac1fc21043da6e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:25:58Z,use_quota=True,user_id='506ae29c67d847b2ba60a17f4916378f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:58.197747 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236f0743-ccd4-498b-af69-50c7fcee9436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:58.203499 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236f0743-ccd4-498b-af69-50c7fcee9436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:58.209248 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09896d2d-4ae5-4e2e-ad31-38a7be363bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:58.213739 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09896d2d-4ae5-4e2e-ad31-38a7be363bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905727c9-67f4-4ef4-bd5a-b573223ada99', 'volume_name': 'volume-905727c9-67f4-4ef4-bd5a-b573223ada99', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:58.218411 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5738e6-3ed6-45af-a37c-b50a3870440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:58.222208 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5738e6-3ed6-45af-a37c-b50a3870440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:58.227082 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd44546a-e28c-48a6-bc16-d60255418ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:58.228234 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Volume 905727c9-67f4-4ef4-bd5a-b573223ada99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905727c9-67f4-4ef4-bd5a-b573223ada99', 'volume_size': 1} Jun 04 21:25:58.228678 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] creating volume 'volume-905727c9-67f4-4ef4-bd5a-b573223ada99' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:25:58.229519 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:58.304214 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:25:58.304461 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:25:58.308649 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd44546a-e28c-48a6-bc16-d60255418ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905727c9-67f4-4ef4-bd5a-b573223ada99', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:58.313060 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6179eb9-3ea6-441c-9d03-d41e83758ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:25:58.324397 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Volume volume-905727c9-67f4-4ef4-bd5a-b573223ada99 (905727c9-67f4-4ef4-bd5a-b573223ada99): created successfully Jun 04 21:25:58.328395 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6179eb9-3ea6-441c-9d03-d41e83758ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:25:58.334006 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Flow 'volume_create_manager' (88043831-c161-4d3f-bdf4-a621c65c5eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:25:58.343206 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b2b4193f-a51a-46e7-a342-65ebce21ade2 tempest-VolumesServicesTestJSON-503581482 None] Created volume successfully. Jun 04 21:25:59.331571 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3a507654-6f00-4829-b912-4837b695f521 tempest-VolumesServicesTestJSON-503581482 None] Lock "b'cinder-905727c9-67f4-4ef4-bd5a-b573223ada99-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:25:59.391722 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3a507654-6f00-4829-b912-4837b695f521 tempest-VolumesServicesTestJSON-503581482 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:59.451356 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3a507654-6f00-4829-b912-4837b695f521 tempest-VolumesServicesTestJSON-503581482 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:25:59.451813 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3a507654-6f00-4829-b912-4837b695f521 tempest-VolumesServicesTestJSON-503581482 None] Volume volume-905727c9-67f4-4ef4-bd5a-b573223ada99 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:25:59.457433 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3a507654-6f00-4829-b912-4837b695f521 tempest-VolumesServicesTestJSON-503581482 None] deleting rbd volume volume-905727c9-67f4-4ef4-bd5a-b573223ada99 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:25:59.828000 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-3a507654-6f00-4829-b912-4837b695f521 tempest-VolumesServicesTestJSON-503581482 None] Created reservations ['a8bf5827-6fa6-48be-b80c-e28ef9857cb8', '2cfb0b14-f699-4706-a3d8-b1d6bb07a828', 'c90d9d57-c481-4c63-a4c4-5c7f6a7c1de8', '8ee7d449-c655-4b37-9a2f-f289da4f2a38'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:25:59.892328 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3a507654-6f00-4829-b912-4837b695f521 tempest-VolumesServicesTestJSON-503581482 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:59.936064 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-3a507654-6f00-4829-b912-4837b695f521 tempest-VolumesServicesTestJSON-503581482 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:25:59.980255 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-3a507654-6f00-4829-b912-4837b695f521 tempest-VolumesServicesTestJSON-503581482 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:25:59.984814 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-3a507654-6f00-4829-b912-4837b695f521 tempest-VolumesServicesTestJSON-503581482 None] Deleted volume successfully. Jun 04 21:26:00.000453 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-3a507654-6f00-4829-b912-4837b695f521 tempest-VolumesServicesTestJSON-503581482 None] Lock "b'cinder-905727c9-67f4-4ef4-bd5a-b573223ada99-delete_volume'" released by "delete_volume" :: held 0.669s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:26:07.745344 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:26:07.786000 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Flow 'volume_create_manager' (484b4a39-10a1-4e06-91da-48d5d768987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:26:07.795247 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e8caca-2c04-4ae8-be30-e0edc117d102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:07.823946 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e8caca-2c04-4ae8-be30-e0edc117d102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2076830840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d51ff69f-ea88-4c44-98d0-849d2a457121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411a1993ad0843d1becebbbe8f3bcc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:26:08Z,use_quota=True,user_id='10c980625b724bcebaf0257c570c1d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:07.843011 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ae4e3f-5aed-4f75-acfe-4385d6b84424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:07.854737 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ae4e3f-5aed-4f75-acfe-4385d6b84424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:07.862799 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a26afcd-3707-4bc0-a9d7-6631c9849714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:07.868774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a26afcd-3707-4bc0-a9d7-6631c9849714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd51ff69f-ea88-4c44-98d0-849d2a457121', 'volume_name': 'volume-d51ff69f-ea88-4c44-98d0-849d2a457121', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:07.875982 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192bce10-603c-4c31-ac40-e1106bda401f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:07.881510 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192bce10-603c-4c31-ac40-e1106bda401f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:07.887579 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3293ff1c-fdf7-4486-a20c-c90c3611fbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:07.889687 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Volume d51ff69f-ea88-4c44-98d0-849d2a457121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d51ff69f-ea88-4c44-98d0-849d2a457121', 'volume_size': 1} Jun 04 21:26:07.890407 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] creating volume 'volume-d51ff69f-ea88-4c44-98d0-849d2a457121' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:26:07.891289 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:08.016661 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:26:08.017864 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:26:08.024654 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3293ff1c-fdf7-4486-a20c-c90c3611fbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51ff69f-ea88-4c44-98d0-849d2a457121', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:08.034459 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db87316-1f5c-46f7-b43e-25d36745f2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:08.058043 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Volume volume-d51ff69f-ea88-4c44-98d0-849d2a457121 (d51ff69f-ea88-4c44-98d0-849d2a457121): created successfully Jun 04 21:26:08.063552 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db87316-1f5c-46f7-b43e-25d36745f2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:08.069764 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Flow 'volume_create_manager' (484b4a39-10a1-4e06-91da-48d5d768987a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:26:08.081717 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-fc00f852-fd3c-4a47-8557-d33280fa7181 tempest-VolumesDeleteCascade-2143570775 None] Created volume successfully. Jun 04 21:26:08.967224 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-4ae26428-f219-4b8e-afd1-6280c9351944 tempest-VolumesDeleteCascade-2143570775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:09.324435 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-4ae26428-f219-4b8e-afd1-6280c9351944 tempest-VolumesDeleteCascade-2143570775 None] Create snapshot completed successfully Jun 04 21:26:10.190671 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8641e549-019c-4d99-b5b5-138fd4ad9a81 tempest-VolumesDeleteCascade-2143570775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:11.334931 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8641e549-019c-4d99-b5b5-138fd4ad9a81 tempest-VolumesDeleteCascade-2143570775 None] Create snapshot completed successfully Jun 04 21:26:12.535058 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Lock "b'cinder-d51ff69f-ea88-4c44-98d0-849d2a457121-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:26:12.696594 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Performing cascade delete. {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/manager.py:968}} Jun 04 21:26:12.730127 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Lock "b'cinder-53255347-ae95-4f8c-81ea-bd551e1216b1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:26:12.773859 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:13.537974 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Created reservations ['37f6f07d-3b24-419f-a046-d3d8e10d56f7', 'b0b5540f-c4db-4fe6-ad92-886a681d5f07', '62254d02-5fe2-444f-9f34-bedd50731ddd', '164e447b-4b93-4582-98c1-804b2450a704'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:26:13.667916 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Delete snapshot completed successfully. Jun 04 21:26:13.674578 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Lock "b'cinder-53255347-ae95-4f8c-81ea-bd551e1216b1-delete_snapshot'" released by "delete_snapshot" :: held 0.944s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:26:13.682935 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Lock "b'cinder-6b5d46d0-d2dc-4a8f-8053-960571304b3e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.007s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:26:13.713678 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:14.479912 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Created reservations ['972e49aa-e32d-412d-915f-d293b72cc478', '693ecbb7-d8ff-4e3c-86fc-abf09bacd493', 'bae9ed01-88c6-49b6-967a-1384faa3c147', '6d788f46-7846-42ae-8c7a-1bbf73c5aa73'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:26:14.530217 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Delete snapshot completed successfully. Jun 04 21:26:14.536039 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Lock "b'cinder-6b5d46d0-d2dc-4a8f-8053-960571304b3e-delete_snapshot'" released by "delete_snapshot" :: held 0.853s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:26:14.537247 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Snapshots deleted, issuing volume delete {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/manager.py:983}} Jun 04 21:26:14.538381 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:14.629029 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:26:14.629517 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Volume volume-d51ff69f-ea88-4c44-98d0-849d2a457121 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:26:14.644834 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] deleting rbd volume volume-d51ff69f-ea88-4c44-98d0-849d2a457121 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:26:15.116886 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=64,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:15.177109 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Created reservations ['65b6a2de-9577-4385-8027-1e73e669c68f', '27e37cd6-bb32-454a-8aed-f35bca8a07d6', 'b9c766f7-1f93-47fb-8384-fc1cb794c8bb', '546fe69e-2dcd-4f69-8aff-d84f54d4c23a'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:26:15.201651 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=61,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=10 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:15.257317 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:15.319832 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:15.388437 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:26:15.394655 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Deleted volume successfully. Jun 04 21:26:15.411308 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-13be4000-e3f8-41e0-995f-38b096244376 tempest-VolumesDeleteCascade-2143570775 None] Lock "b'cinder-d51ff69f-ea88-4c44-98d0-849d2a457121-delete_volume'" released by "delete_volume" :: held 2.878s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:26:18.591724 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:26:18.646720 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Flow 'volume_create_manager' (647ec72e-34e8-4474-a606-7f65b5b10ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:26:18.653100 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9433ca68-7053-4243-8020-2b7516537927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:18.670142 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9433ca68-7053-4243-8020-2b7516537927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-203943414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4cc52d0d-08d3-4720-b0fc-21479a9f3af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09267f58c3a6428f9377739c93006777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:26:19Z,use_quota=True,user_id='621162cfb6d34ecc99d38689c3690d75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:18.676005 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be8c2e7-5a7d-4d2e-806a-a6ef6c0211f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:18.680112 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be8c2e7-5a7d-4d2e-806a-a6ef6c0211f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:18.685082 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e851ff7-635a-4e56-9c86-f9d6070140f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:18.689457 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e851ff7-635a-4e56-9c86-f9d6070140f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc52d0d-08d3-4720-b0fc-21479a9f3af8', 'volume_name': 'volume-4cc52d0d-08d3-4720-b0fc-21479a9f3af8', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:18.694915 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e79bddb-314b-40ad-a507-d03b86372c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:18.698722 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e79bddb-314b-40ad-a507-d03b86372c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:18.703189 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa1914d-a1c5-481d-a1ce-cab44e6ab3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:18.704294 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Volume 4cc52d0d-08d3-4720-b0fc-21479a9f3af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc52d0d-08d3-4720-b0fc-21479a9f3af8', 'volume_size': 1} Jun 04 21:26:18.704690 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] creating volume 'volume-4cc52d0d-08d3-4720-b0fc-21479a9f3af8' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:26:18.705717 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:18.777243 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:26:18.777708 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:26:18.781436 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa1914d-a1c5-481d-a1ce-cab44e6ab3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc52d0d-08d3-4720-b0fc-21479a9f3af8', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:18.786287 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2967b5cd-d5a9-4463-b718-4189fece40a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:26:18.798403 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Volume volume-4cc52d0d-08d3-4720-b0fc-21479a9f3af8 (4cc52d0d-08d3-4720-b0fc-21479a9f3af8): created successfully Jun 04 21:26:18.802452 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2967b5cd-d5a9-4463-b718-4189fece40a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:26:18.808429 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Flow 'volume_create_manager' (647ec72e-34e8-4474-a606-7f65b5b10ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:26:18.819581 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-e50075e1-4a92-4863-a7fe-f9d5d7b0835b tempest-VolumesBackupsV39Test-1548175368 None] Created volume successfully. Jun 04 21:26:19.765594 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9e3670ef-5077-473f-b87a-ebdf2d5c0308 tempest-VolumesBackupsV39Test-1548175368 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-04T21:26:19Z,data_timestamp=2022-06-04T21:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1520483896',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=d6e170c1-c6cc-4a27-84ab-d09661f4dd4e,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='09267f58c3a6428f9377739c93006777',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='621162cfb6d34ecc99d38689c3690d75',volume_id=4cc52d0d-08d3-4720-b0fc-21479a9f3af8) Jun 04 21:26:19.766269 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.backup.rpcapi [None req-9e3670ef-5077-473f-b87a-ebdf2d5c0308 tempest-VolumesBackupsV39Test-1548175368 None] continue_backup in rpcapi backup_id d6e170c1-c6cc-4a27-84ab-d09661f4dd4e {{(pid=130490) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 04 21:26:19.917779 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-9e3670ef-5077-473f-b87a-ebdf2d5c0308 tempest-VolumesBackupsV39Test-1548175368 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:26:20.669144 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [None req-9e3670ef-5077-473f-b87a-ebdf2d5c0308 tempest-VolumesBackupsV39Test-1548175368 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.751s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:26:20.670739 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-9e3670ef-5077-473f-b87a-ebdf2d5c0308 tempest-VolumesBackupsV39Test-1548175368 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4cc52d0d-08d3-4720-b0fc-21479a9f3af8', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '4cc52d0d-08d3-4720-b0fc-21479a9f3af8', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:26:20.692709 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9e3670ef-5077-473f-b87a-ebdf2d5c0308 tempest-VolumesBackupsV39Test-1548175368 None] Initialize volume connection completed successfully. Jun 04 21:26:22.389773 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9e3670ef-5077-473f-b87a-ebdf2d5c0308 tempest-VolumesBackupsV39Test-1548175368 None] Terminate volume connection completed successfully. Jun 04 21:26:22.408783 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-9e3670ef-5077-473f-b87a-ebdf2d5c0308 tempest-VolumesBackupsV39Test-1548175368 None] Remove volume export completed successfully. Jun 04 21:26:25.130333 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-8709ed29-f291-4467-90a1-39403cf6fba0 tempest-VolumesBackupsV39Test-1548175368 None] Lock "b'cinder-4cc52d0d-08d3-4720-b0fc-21479a9f3af8-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:26:25.173864 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8709ed29-f291-4467-90a1-39403cf6fba0 tempest-VolumesBackupsV39Test-1548175368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:25.760177 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8709ed29-f291-4467-90a1-39403cf6fba0 tempest-VolumesBackupsV39Test-1548175368 None] Volume volume-4cc52d0d-08d3-4720-b0fc-21479a9f3af8 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:26:25.779204 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8709ed29-f291-4467-90a1-39403cf6fba0 tempest-VolumesBackupsV39Test-1548175368 None] deleting rbd volume volume-4cc52d0d-08d3-4720-b0fc-21479a9f3af8 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:26:26.019076 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-8709ed29-f291-4467-90a1-39403cf6fba0 tempest-VolumesBackupsV39Test-1548175368 None] Created reservations ['d7721e58-8b08-4b92-adbe-364e10fdf368', 'bf24bfa9-7451-4db5-a075-249475692a7d', 'c73becd2-d8e8-4218-b159-c02d1045e906', '2aa7bba4-5ee5-42d4-b128-c3cb7502f195'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:26:26.065695 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8709ed29-f291-4467-90a1-39403cf6fba0 tempest-VolumesBackupsV39Test-1548175368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:26.089225 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-8709ed29-f291-4467-90a1-39403cf6fba0 tempest-VolumesBackupsV39Test-1548175368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:26.114537 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-8709ed29-f291-4467-90a1-39403cf6fba0 tempest-VolumesBackupsV39Test-1548175368 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:26:26.118736 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-8709ed29-f291-4467-90a1-39403cf6fba0 tempest-VolumesBackupsV39Test-1548175368 None] Deleted volume successfully. Jun 04 21:26:26.133341 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-8709ed29-f291-4467-90a1-39403cf6fba0 tempest-VolumesBackupsV39Test-1548175368 None] Lock "b'cinder-4cc52d0d-08d3-4720-b0fc-21479a9f3af8-delete_volume'" released by "delete_volume" :: held 1.003s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:26:36.244221 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=21,cinder:SELECT=25,cinder:DELETE=2,cinder:INSERT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:44.302503 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-1b593b14-2a79-491f-97b8-bec4ebd90771 req-15423aab-b665-4129-893c-8cc6ff4e9257 tempest-TestVolumeBootPattern-524389578 None] Terminate volume connection completed successfully. Jun 04 21:26:44.303207 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-1b593b14-2a79-491f-97b8-bec4ebd90771 req-15423aab-b665-4129-893c-8cc6ff4e9257 tempest-TestVolumeBootPattern-524389578 None] Deleting attachment ac4ead07-33e1-4817-99b9-107d07715ec0. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:26:45.870070 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2d53eda7-7225-40ff-91e4-f6a79832bda3 tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-cf8fbba4-3ff5-451e-9e8c-477486db525d-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:26:45.877493 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:DELETE=1,cinder:SELECT=36,cinder:UPDATE=13,cinder:INSERT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:45.912052 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2d53eda7-7225-40ff-91e4-f6a79832bda3 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:45.985878 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2d53eda7-7225-40ff-91e4-f6a79832bda3 tempest-TestVolumeBootPattern-524389578 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:26:45.992890 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2d53eda7-7225-40ff-91e4-f6a79832bda3 tempest-TestVolumeBootPattern-524389578 None] deleting rbd volume volume-cf8fbba4-3ff5-451e-9e8c-477486db525d {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:26:46.075597 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:26:46.076174 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:46.100533 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:46.125223 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:26:46.291237 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-2d53eda7-7225-40ff-91e4-f6a79832bda3 tempest-TestVolumeBootPattern-524389578 None] Created reservations ['2d77f1e7-6192-4d05-ae29-b9c70dff8130', 'ac8863da-ecd9-4144-b3a4-48a313368c49', '0e2b8ba2-f196-4da9-b6cd-9ec9ee943850', 'a4e9d749-282f-4a0b-b2ed-d43432b34cf7'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:26:46.339597 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2d53eda7-7225-40ff-91e4-f6a79832bda3 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:46.368599 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2d53eda7-7225-40ff-91e4-f6a79832bda3 tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:26:46.396017 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-2d53eda7-7225-40ff-91e4-f6a79832bda3 tempest-TestVolumeBootPattern-524389578 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:26:46.400429 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2d53eda7-7225-40ff-91e4-f6a79832bda3 tempest-TestVolumeBootPattern-524389578 None] Deleted volume successfully. Jun 04 21:26:46.413653 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2d53eda7-7225-40ff-91e4-f6a79832bda3 tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-cf8fbba4-3ff5-451e-9e8c-477486db525d-delete_volume'" released by "delete_volume" :: held 0.544s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:26:47.019390 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-879b534c-bcb4-4d3d-8a35-5172b75c547c tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-67e9b32e-203e-4106-b03a-44c9c02a8785-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:26:47.021057 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-879b534c-bcb4-4d3d-8a35-5172b75c547c tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:27:16.237861 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=12,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:16.240390 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=23,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:17.202198 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-879b534c-bcb4-4d3d-8a35-5172b75c547c tempest-TestVolumeBootPattern-524389578 None] Created reservations ['edfb2359-59fd-4da6-8298-036ea495d863', '43296828-fe83-4248-92f9-7d487bb02a59', 'a39b14ff-96a8-4f87-9904-f8e8ada68b78', '4cf4cc91-946f-401b-a7af-85af6cbf57fa'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:27:17.253629 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-879b534c-bcb4-4d3d-8a35-5172b75c547c tempest-TestVolumeBootPattern-524389578 None] Delete snapshot completed successfully. Jun 04 21:27:17.258697 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-879b534c-bcb4-4d3d-8a35-5172b75c547c tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-67e9b32e-203e-4106-b03a-44c9c02a8785-delete_snapshot'" released by "delete_snapshot" :: held 30.239s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:27:21.426851 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-1f16dcb3-9c5f-4593-8fd2-1456c9731aae req-88393de0-6318-48c1-8bcd-2a80577061b6 tempest-TestVolumeBootPattern-524389578 None] Terminate volume connection completed successfully. Jun 04 21:27:21.427596 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-1f16dcb3-9c5f-4593-8fd2-1456c9731aae req-88393de0-6318-48c1-8bcd-2a80577061b6 tempest-TestVolumeBootPattern-524389578 None] Deleting attachment ca405595-cc46-42fd-9552-cdc6f30b7be3. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:27:23.493463 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-6121e434-b2b6-4783-9a4b-90d85dc648ef-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:27:23.526749 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:27:23.592709 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:27:23.601810 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] deleting rbd volume volume-6121e434-b2b6-4783-9a4b-90d85dc648ef {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:27:23.901068 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 21:27:23.945347 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] deleting parent snapshot volume-6121e434-b2b6-4783-9a4b-90d85dc648ef.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 21:27:24.853845 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] Created reservations ['af719217-f31d-4b0e-b4c3-f337dfe252c8', 'acd561f0-417f-4d70-bd3d-d2a4775e215f', 'b49edfe4-e435-4949-b3a0-79fe42cb4ff0', '886af981-f0a5-4f39-a567-58d438941baa'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:27:24.909461 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:27:24.933253 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:27:24.963758 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:27:24.970037 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] Deleted volume successfully. Jun 04 21:27:24.984728 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-d6ad5e88-f475-4e9d-b773-bb895d2d5dbe tempest-TestVolumeBootPattern-524389578 None] Lock "b'cinder-6121e434-b2b6-4783-9a4b-90d85dc648ef-delete_volume'" released by "delete_volume" :: held 1.491s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:27:46.081627 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:27:46.082338 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:27:46.119375 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:27:46.152216 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:27:56.237044 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=28,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:56.240573 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=29,cinder:INSERT=4,cinder:UPDATE=15 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:16.243501 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:36.245285 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:46.081211 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:28:46.081955 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:28:46.110525 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:28:46.135335 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:28:56.249421 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:56.251424 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:36.251588 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:36.254177 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:46.082237 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:29:46.082973 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:29:46.113772 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:29:46.147049 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:30:06.264471 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:06.267135 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:36.254056 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:46.082704 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:30:46.083538 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:30:46.109614 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:30:46.132172 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:30:46.263082 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:46.267079 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:06.278830 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:16.278269 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:36.280317 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:46.088325 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:31:46.089022 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:31:46.117408 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:31:46.142860 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:31:56.266460 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:06.279153 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:36.274479 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:46.088900 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:32:46.089677 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:32:46.114364 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:32:46.137866 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:32:46.280748 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:16.279134 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:26.283253 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:46.095410 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:33:46.096135 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:33:46.119785 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:33:46.142588 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:33:56.278400 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:06.282069 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:36.281313 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:46.099832 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:34:46.100563 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:34:46.123822 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:34:46.148346 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:34:46.280173 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:16.278645 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:26.280509 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:46.103618 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:35:46.105951 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:35:46.132505 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:35:46.158398 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:35:56.273372 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:06.280401 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:16.281667 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:46.104373 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:36:46.105082 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:36:46.130620 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:36:46.158788 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:36:46.275627 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:56.281951 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:26.271186 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:36.269460 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:46.104408 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:37:46.105165 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:37:46.132015 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:37:46.158165 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:37:56.276639 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:56.277754 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:36.279029 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:36.282222 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:46.105517 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:38:46.106473 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:38:46.133862 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:38:46.157261 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:38:56.283157 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:16.285192 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:26.299469 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:46.104178 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:39:46.105274 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:39:46.138888 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:39:46.161920 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:39:46.292020 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:46.301372 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:06.296551 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:26.296245 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:36.307158 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:46.108330 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:40:46.109424 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:40:46.143423 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:40:46.167102 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:40:46.306580 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:41:16.304701 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:41:26.304236 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:41:46.112935 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:41:46.114111 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:41:46.150342 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:41:46.173266 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:41:56.292287 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:06.288732 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:26.305997 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:26.310447 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:46.110166 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:42:46.110846 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:42:46.143919 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:42:46.170683 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:42:56.291646 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:06.289177 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:16.303484 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:29.174889 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:43:29.195985 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Flow 'volume_create_manager' (ba35cccd-4eda-41a5-a4a1-1a408ed22423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:43:29.202327 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f422fab-331b-4a9b-9497-d4dc13638355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:43:29.219278 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f422fab-331b-4a9b-9497-d4dc13638355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1243233769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=20b7ae1b-9353-4aaa-a267-82f69dec40b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4089cd0379c94abe9a77baa27012aa7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:43:29Z,use_quota=True,user_id='ce8a9c03cdf04d72bbecb875aa275693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:43:29.224386 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5710dcd-b5b3-48e7-b585-b0b9f3844427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:43:29.228402 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5710dcd-b5b3-48e7-b585-b0b9f3844427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:43:29.233399 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2712d27c-f0d7-482b-8fc5-ddf6cb383f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:43:29.237275 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2712d27c-f0d7-482b-8fc5-ddf6cb383f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'volume_name': 'volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:43:29.241952 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239b4e50-7742-4468-a12a-55b8923b86d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:43:29.245798 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239b4e50-7742-4468-a12a-55b8923b86d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:43:29.250254 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136b391e-abd0-4426-ad50-076f8a0bfc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:43:29.251328 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Volume 20b7ae1b-9353-4aaa-a267-82f69dec40b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'volume_size': 1} Jun 04 21:43:29.251738 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] creating volume 'volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:43:29.252501 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:43:29.319152 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:43:29.319552 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:43:29.323269 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136b391e-abd0-4426-ad50-076f8a0bfc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:43:29.327799 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17149d07-79a3-47b3-ac94-b31cc6f91665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:43:29.339476 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Volume volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3 (20b7ae1b-9353-4aaa-a267-82f69dec40b3): created successfully Jun 04 21:43:29.342862 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17149d07-79a3-47b3-ac94-b31cc6f91665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:43:29.348274 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Flow 'volume_create_manager' (ba35cccd-4eda-41a5-a4a1-1a408ed22423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:43:29.357765 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-72542bfd-30f5-44b9-9eb9-1a63aeb7b29a tempest-ServerActionsTestJSON-1358527532 None] Created volume successfully. Jun 04 21:43:30.811984 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-29693e16-7c1f-4624-bcd7-835544c9cff6 req-241f0538-48b7-4b0d-93a3-89ce661d9806 tempest-ServerActionsTestJSON-1358527532 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:43:31.433844 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-29693e16-7c1f-4624-bcd7-835544c9cff6 req-241f0538-48b7-4b0d-93a3-89ce661d9806 tempest-ServerActionsTestJSON-1358527532 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.621s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:43:31.434843 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-29693e16-7c1f-4624-bcd7-835544c9cff6 req-241f0538-48b7-4b0d-93a3-89ce661d9806 tempest-ServerActionsTestJSON-1358527532 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:43:31.472768 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-29693e16-7c1f-4624-bcd7-835544c9cff6 req-241f0538-48b7-4b0d-93a3-89ce661d9806 tempest-ServerActionsTestJSON-1358527532 None] Connection info returned from driver {'name': 'volumes/volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '07656f46-fca1-4866-99bd-254e0b24bfa7'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:43:31.524661 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-29693e16-7c1f-4624-bcd7-835544c9cff6 req-241f0538-48b7-4b0d-93a3-89ce661d9806 tempest-ServerActionsTestJSON-1358527532 None] attachment_update completed successfully. Jun 04 21:43:46.106070 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:43:46.106967 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:43:46.148948 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:43:46.173738 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:43:46.292712 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=23,cinder:UPDATE=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:48.585026 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:48.596348 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b req-66f76122-f773-4a6d-a638-326c1d74377c tempest-ServerActionsTestJSON-1358527532 None] Terminate volume connection completed successfully. Jun 04 21:43:48.596758 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b req-66f76122-f773-4a6d-a638-326c1d74377c tempest-ServerActionsTestJSON-1358527532 None] Deleting attachment 07656f46-fca1-4866-99bd-254e0b24bfa7. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:43:50.648443 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b req-29ae1c5a-4a15-4aaf-898c-5993f5d6dbf7 tempest-ServerActionsTestJSON-1358527532 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:43:51.278474 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b req-29ae1c5a-4a15-4aaf-898c-5993f5d6dbf7 tempest-ServerActionsTestJSON-1358527532 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.630s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:43:51.280526 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b req-29ae1c5a-4a15-4aaf-898c-5993f5d6dbf7 tempest-ServerActionsTestJSON-1358527532 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:43:51.312933 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b req-29ae1c5a-4a15-4aaf-898c-5993f5d6dbf7 tempest-ServerActionsTestJSON-1358527532 None] Connection info returned from driver {'name': 'volumes/volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c172388a-e7cb-4b1a-b1b6-7155d759d031'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:43:51.402009 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b req-29ae1c5a-4a15-4aaf-898c-5993f5d6dbf7 tempest-ServerActionsTestJSON-1358527532 None] attachment_update completed successfully. Jun 04 21:43:59.880404 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 req-59e81cae-9adb-4183-ae99-c6050d37e595 tempest-ServerActionsTestJSON-1358527532 None] Terminate volume connection completed successfully. Jun 04 21:43:59.881101 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 req-59e81cae-9adb-4183-ae99-c6050d37e595 tempest-ServerActionsTestJSON-1358527532 None] Deleting attachment c172388a-e7cb-4b1a-b1b6-7155d759d031. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:44:02.266202 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 req-462bcf35-fd69-4052-b395-b6f7bbc90bb3 tempest-ServerActionsTestJSON-1358527532 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:44:02.890045 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 req-462bcf35-fd69-4052-b395-b6f7bbc90bb3 tempest-ServerActionsTestJSON-1358527532 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.623s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:44:02.890774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 req-462bcf35-fd69-4052-b395-b6f7bbc90bb3 tempest-ServerActionsTestJSON-1358527532 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:44:02.919279 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 req-462bcf35-fd69-4052-b395-b6f7bbc90bb3 tempest-ServerActionsTestJSON-1358527532 None] Connection info returned from driver {'name': 'volumes/volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '20b7ae1b-9353-4aaa-a267-82f69dec40b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9595bdf6-1c38-4aed-aeff-943df8b9fd8d'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:44:02.971436 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 req-462bcf35-fd69-4052-b395-b6f7bbc90bb3 tempest-ServerActionsTestJSON-1358527532 None] attachment_update completed successfully. Jun 04 21:44:09.682629 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-0ec91da0-7995-472f-8f87-8a5af57aba87 req-387eb4ee-8ac2-43b7-b5d9-15f2acf09f10 tempest-ServerActionsTestJSON-1358527532 None] Terminate volume connection completed successfully. Jun 04 21:44:09.683361 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-0ec91da0-7995-472f-8f87-8a5af57aba87 req-387eb4ee-8ac2-43b7-b5d9-15f2acf09f10 tempest-ServerActionsTestJSON-1358527532 None] Deleting attachment 9595bdf6-1c38-4aed-aeff-943df8b9fd8d. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:44:10.948561 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-78324c52-9797-4ce4-8896-d97b75d127f9 tempest-ServerActionsTestJSON-1358527532 None] Lock "b'cinder-20b7ae1b-9353-4aaa-a267-82f69dec40b3-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:44:10.981766 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-78324c52-9797-4ce4-8896-d97b75d127f9 tempest-ServerActionsTestJSON-1358527532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:44:11.023263 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-78324c52-9797-4ce4-8896-d97b75d127f9 tempest-ServerActionsTestJSON-1358527532 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:44:11.023656 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-78324c52-9797-4ce4-8896-d97b75d127f9 tempest-ServerActionsTestJSON-1358527532 None] Volume volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:44:11.032729 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-78324c52-9797-4ce4-8896-d97b75d127f9 tempest-ServerActionsTestJSON-1358527532 None] deleting rbd volume volume-20b7ae1b-9353-4aaa-a267-82f69dec40b3 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:44:11.282809 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-78324c52-9797-4ce4-8896-d97b75d127f9 tempest-ServerActionsTestJSON-1358527532 None] Created reservations ['f8c3eb50-a632-4fcd-adc4-8d407e04541b', 'e8a596cc-f474-4002-98ae-6534c2f6992b', '2967e1cd-8b2c-482a-9fdf-a7037bfea3b6', '6ae48446-90f2-47a6-85c2-54d95aadc67e'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:44:11.331963 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-78324c52-9797-4ce4-8896-d97b75d127f9 tempest-ServerActionsTestJSON-1358527532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:44:11.354941 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-78324c52-9797-4ce4-8896-d97b75d127f9 tempest-ServerActionsTestJSON-1358527532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:44:11.381885 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-78324c52-9797-4ce4-8896-d97b75d127f9 tempest-ServerActionsTestJSON-1358527532 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:44:11.386342 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-78324c52-9797-4ce4-8896-d97b75d127f9 tempest-ServerActionsTestJSON-1358527532 None] Deleted volume successfully. Jun 04 21:44:11.400063 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-78324c52-9797-4ce4-8896-d97b75d127f9 tempest-ServerActionsTestJSON-1358527532 None] Lock "b'cinder-20b7ae1b-9353-4aaa-a267-82f69dec40b3-delete_volume'" released by "delete_volume" :: held 0.452s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:44:26.298437 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=47,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:26.301379 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=41,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:46.109339 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:44:46.110062 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:44:46.135311 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:44:46.162193 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:44:46.303368 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:56.300428 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:26.296894 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:46.106345 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:45:46.107017 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:45:46.130315 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:45:46.161405 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:45:46.298696 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:49.792025 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:45:49.811633 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Flow 'volume_create_manager' (8b1334a4-d61a-4503-8021-6cfa4b3cb530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:45:49.817928 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8b9a1d-8a9e-4d97-8515-2778c780371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:45:49.834256 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8b9a1d-8a9e-4d97-8515-2778c780371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1133796150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=472cdb18-8fee-48d0-a481-1de21f03a120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0664a859e40746a59c5cf6e6c0c6a1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:45:50Z,use_quota=True,user_id='4a7dbe74559048949cdf5658d15925c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:45:49.839341 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e440da79-bd2a-424d-b8b8-256b99cfd1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:45:49.843206 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e440da79-bd2a-424d-b8b8-256b99cfd1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:45:49.848020 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ea6680-75e2-4fda-bb09-20bffdc4d302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:45:49.851834 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ea6680-75e2-4fda-bb09-20bffdc4d302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '472cdb18-8fee-48d0-a481-1de21f03a120', 'volume_name': 'volume-472cdb18-8fee-48d0-a481-1de21f03a120', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:45:49.856447 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afb4d2a-2632-4b3a-9fb9-8fc9fac56d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:45:49.860112 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afb4d2a-2632-4b3a-9fb9-8fc9fac56d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:45:49.864579 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632a5a2c-34d9-42cc-bb3f-2b87fa04a5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:45:49.865603 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Volume 472cdb18-8fee-48d0-a481-1de21f03a120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-472cdb18-8fee-48d0-a481-1de21f03a120', 'volume_size': 1} Jun 04 21:45:49.865988 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] creating volume 'volume-472cdb18-8fee-48d0-a481-1de21f03a120' {{(pid=130490) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} Jun 04 21:45:49.866738 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:45:50.001410 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:45:50.001788 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:45:50.005696 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632a5a2c-34d9-42cc-bb3f-2b87fa04a5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-472cdb18-8fee-48d0-a481-1de21f03a120', 'volume_size': 1}' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:45:50.010195 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208050b6-a99c-4a23-b308-80b9e0dfa84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:45:50.022164 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Volume volume-472cdb18-8fee-48d0-a481-1de21f03a120 (472cdb18-8fee-48d0-a481-1de21f03a120): created successfully Jun 04 21:45:50.025586 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208050b6-a99c-4a23-b308-80b9e0dfa84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:45:50.030811 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Flow 'volume_create_manager' (8b1334a4-d61a-4503-8021-6cfa4b3cb530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:45:50.039559 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-b4b25b87-8c68-42d9-86e5-7277a17d1359 tempest-TestMinimumBasicScenario-1027701286 None] Created volume successfully. Jun 04 21:45:51.378816 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-f091e59a-a1da-40d7-95e4-6a3162649dd0 req-65346875-18f0-4d3a-9eff-4613ae2bec9d tempest-TestMinimumBasicScenario-1027701286 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:45:52.114360 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-f091e59a-a1da-40d7-95e4-6a3162649dd0 req-65346875-18f0-4d3a-9eff-4613ae2bec9d tempest-TestMinimumBasicScenario-1027701286 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.734s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:45:52.115230 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-f091e59a-a1da-40d7-95e4-6a3162649dd0 req-65346875-18f0-4d3a-9eff-4613ae2bec9d tempest-TestMinimumBasicScenario-1027701286 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-472cdb18-8fee-48d0-a481-1de21f03a120', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '472cdb18-8fee-48d0-a481-1de21f03a120', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:45:52.142799 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-f091e59a-a1da-40d7-95e4-6a3162649dd0 req-65346875-18f0-4d3a-9eff-4613ae2bec9d tempest-TestMinimumBasicScenario-1027701286 None] Connection info returned from driver {'name': 'volumes/volume-472cdb18-8fee-48d0-a481-1de21f03a120', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '472cdb18-8fee-48d0-a481-1de21f03a120', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e5c2f9d9-efb5-4905-a0e3-09590351b5e7'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:45:52.197232 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-f091e59a-a1da-40d7-95e4-6a3162649dd0 req-65346875-18f0-4d3a-9eff-4613ae2bec9d tempest-TestMinimumBasicScenario-1027701286 None] attachment_update completed successfully. Jun 04 21:46:06.293747 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=4,cinder:SELECT=21,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:46:26.305098 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:46:36.315692 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:46:46.108427 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:46:46.109237 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:46:46.135458 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:46:46.162807 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:47:06.314450 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:13.804310 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:13.809614 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-178ca600-8ec3-4919-ae0d-9aae8415644e req-1a3fabe5-2fd7-4d8b-8a1d-a59aff1a95fc tempest-TestMinimumBasicScenario-1027701286 None] Terminate volume connection completed successfully. Jun 04 21:47:13.810032 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-178ca600-8ec3-4919-ae0d-9aae8415644e req-1a3fabe5-2fd7-4d8b-8a1d-a59aff1a95fc tempest-TestMinimumBasicScenario-1027701286 None] Deleting attachment e5c2f9d9-efb5-4905-a0e3-09590351b5e7. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 21:47:14.490328 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2045349f-6bc7-4439-952b-d5e29a524b09 tempest-TestMinimumBasicScenario-1027701286 None] Lock "b'cinder-472cdb18-8fee-48d0-a481-1de21f03a120-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:47:14.526097 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2045349f-6bc7-4439-952b-d5e29a524b09 tempest-TestMinimumBasicScenario-1027701286 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:47:14.563432 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2045349f-6bc7-4439-952b-d5e29a524b09 tempest-TestMinimumBasicScenario-1027701286 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 21:47:14.564023 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2045349f-6bc7-4439-952b-d5e29a524b09 tempest-TestMinimumBasicScenario-1027701286 None] Volume volume-472cdb18-8fee-48d0-a481-1de21f03a120 is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:47:14.571855 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2045349f-6bc7-4439-952b-d5e29a524b09 tempest-TestMinimumBasicScenario-1027701286 None] deleting rbd volume volume-472cdb18-8fee-48d0-a481-1de21f03a120 {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 21:47:14.820503 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [None req-2045349f-6bc7-4439-952b-d5e29a524b09 tempest-TestMinimumBasicScenario-1027701286 None] Created reservations ['9fa8c056-15b5-4b7e-88f3-dd919135d522', '8b7d1bba-b3ac-401f-bd1f-21dffd899306', '7464d506-716b-472e-b43f-5b76fa5404c3', '42dff72f-44fa-4a24-af4c-7d79fca97292'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 21:47:14.869253 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2045349f-6bc7-4439-952b-d5e29a524b09 tempest-TestMinimumBasicScenario-1027701286 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:47:14.892122 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-2045349f-6bc7-4439-952b-d5e29a524b09 tempest-TestMinimumBasicScenario-1027701286 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:47:14.918660 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-2045349f-6bc7-4439-952b-d5e29a524b09 tempest-TestMinimumBasicScenario-1027701286 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:47:14.923495 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-2045349f-6bc7-4439-952b-d5e29a524b09 tempest-TestMinimumBasicScenario-1027701286 None] Deleted volume successfully. Jun 04 21:47:14.939027 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-2045349f-6bc7-4439-952b-d5e29a524b09 tempest-TestMinimumBasicScenario-1027701286 None] Lock "b'cinder-472cdb18-8fee-48d0-a481-1de21f03a120-delete_volume'" released by "delete_volume" :: held 0.449s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:47:26.323428 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:36.337535 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=19,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:46.109266 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:47:46.110036 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:47:46.137601 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:47:46.163798 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:48:06.312430 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:16.311163 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:36.319974 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:46.109930 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:48:46.110627 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:48:46.133742 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:48:46.159565 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:48:56.314256 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:49:16.322397 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:49:36.321796 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:49:46.115677 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:49:46.116727 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:49:46.146967 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:49:46.171322 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:49:56.332878 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:16.326089 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:36.334415 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:46.117427 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:50:46.118194 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:50:46.141967 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:50:46.165411 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:50:56.340490 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:16.331475 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:36.330026 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:46.121794 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:51:46.122568 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:51:46.146878 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:51:46.169686 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:51:56.332052 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:16.332518 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:36.338341 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:46.126247 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:52:46.127343 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:52:46.162835 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:52:46.186801 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:52:56.328507 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:56.331113 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:26.342005 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:36.343135 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:46.123686 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:53:46.124414 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:53:46.147920 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:53:46.174447 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:53:56.335275 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:06.352409 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:26.347776 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:26.348475 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:46.120590 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:54:46.121289 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:54:46.144212 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:54:46.170449 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:54:46.349557 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:56.359129 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:55:26.345185 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:55:46.126924 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:55:46.127719 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:55:46.154522 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:55:46.177261 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:55:46.347233 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:56:06.340711 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:56:26.334341 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:56:46.123640 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:56:46.124336 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:56:46.150671 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:56:46.173490 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:56:46.332222 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:06.345916 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:26.334607 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:46.130334 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:57:46.131020 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:57:46.156221 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:57:46.189823 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:57:46.336161 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:56.345403 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:58:26.345745 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:58:36.333329 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:58:46.135271 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:58:46.136062 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:58:46.160825 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:58:46.185812 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:59:06.325190 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:11.347727 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:11.364069 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 04 21:59:11.383451 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Flow 'volume_create_manager' (9cf29de8-03ce-4f9c-a95b-b06faf5df98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:59:11.389814 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e15482-77b0-47fb-a40f-2eb7040d0678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:59:11.407307 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e15482-77b0-47fb-a40f-2eb7040d0678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-04T21:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1261856828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3d9187db-b18d-4cfa-908b-ff26cf626c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179af47cc6864305ab601ac5edd826ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-04T21:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-04T21:59:11Z,use_quota=True,user_id='e94e127dc47a477d848d7ff172109538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3),volume_type_id=6c6073c4-e0c8-43c4-8d4c-1a62eb1ef4b3)' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:59:11.412386 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3ebd22-741d-47af-b2cb-0fa8d1b00114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:59:11.416377 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3ebd22-741d-47af-b2cb-0fa8d1b00114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:59:11.421293 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f43b0ee-b1e8-4c79-9def-8f1d8bd286c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:59:11.516347 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f43b0ee-b1e8-4c79-9def-8f1d8bd286c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'volume_name': 'volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:59:11.521428 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6b7394-9e47-4b9b-89da-ad01053b75ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:59:11.525460 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6b7394-9e47-4b9b-89da-ad01053b75ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:59:11.529905 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea0feeb-8e43-4a9a-adb9-2f4722e33b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:59:11.531112 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Volume 3d9187db-b18d-4cfa-908b-ff26cf626c2a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 21:59:11.531890 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Cloning 3d9187db-b18d-4cfa-908b-ff26cf626c2a from image 926a4015-c327-4be7-9086-5cce1a8e0ebf at location (None, None). {{(pid=130490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 04 21:59:11.540772 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 21:59:11.553442 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 59, 11, 545519)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:59:11.553877 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:59:11.554273 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Found cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 04 21:59:11.558398 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Lock "b'cinder-926a4015-c327-4be7-9086-5cce1a8e0ebf'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 21:59:11.559312 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Attempting to retrieve cache entry for image = 926a4015-c327-4be7-9086-5cce1a8e0ebf on host ncdv-master-1@ceph#ceph. {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 04 21:59:11.565087 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Found image-volume cache entry: {'id': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'volume_id': '9ae28598-c844-4fb8-8842-66d0fa33f643', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45), 'last_used': datetime.datetime(2022, 6, 4, 21, 59, 11, 562900)}. {{(pid=130490) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 04 21:59:11.565495 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.image.cache [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Image-volume cache entry image_update_at = 2022-06-04 20:43:45+00:00, requested image updated_at = 2022-06-04 20:43:45+00:00. {{(pid=130490) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 04 21:59:11.565870 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Creating from source image-volume 9ae28598-c844-4fb8-8842-66d0fa33f643 {{(pid=130490) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 04 21:59:11.577361 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:59:11.651872 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] creating snapshot='volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a.clone_snap' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Jun 04 21:59:12.055681 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] cloning 'volume-9ae28598-c844-4fb8-8842-66d0fa33f643@volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a.clone_snap' to 'volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a' {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} Jun 04 21:59:12.208885 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Volume volume-7b6358b5-f2c7-4f84-93be-b0746120aafa.deleted is not a clone. {{(pid=130490) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Jun 04 21:59:12.210442 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} Jun 04 21:59:12.210936 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130490) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} Jun 04 21:59:12.240423 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] clone created successfully {{(pid=130490) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} Jun 04 21:59:12.241313 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.volume_utils [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Marking volume 3d9187db-b18d-4cfa-908b-ff26cf626c2a as bootable. {{(pid=130490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 04 21:59:12.255165 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Copying metadata from image 926a4015-c327-4be7-9086-5cce1a8e0ebf to 3d9187db-b18d-4cfa-908b-ff26cf626c2a. {{(pid=130490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 04 21:59:12.256006 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.flows.manager.create_volume [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Creating volume glance metadata for volume 3d9187db-b18d-4cfa-908b-ff26cf626c2a backed by image 926a4015-c327-4be7-9086-5cce1a8e0ebf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 04 21:59:12.314241 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea0feeb-8e43-4a9a-adb9-2f4722e33b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'volume_size': 1, 'image_id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '598115c278dc4440816e2bfd4030f050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'created_at': datetime.datetime(2022, 6, 4, 20, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 4, 20, 43, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926a4015-c327-4be7-9086-5cce1a8e0ebf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:59:12.319793 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc76007-f75d-4b97-a66f-e1b0577bb00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 04 21:59:12.329856 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.flows.manager.create_volume [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Volume volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a (3d9187db-b18d-4cfa-908b-ff26cf626c2a): created successfully Jun 04 21:59:12.334053 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc76007-f75d-4b97-a66f-e1b0577bb00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130490) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 04 21:59:12.341510 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Flow 'volume_create_manager' (9cf29de8-03ce-4f9c-a95b-b06faf5df98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130490) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 04 21:59:12.360544 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [None req-56eb1c3e-60d8-440d-bd47-d25b11cd980e tempest-TestShelveInstance-247392491 None] Created volume successfully. Jun 04 21:59:15.394592 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-e7f526ff-eaf4-44b3-b937-127f7f586e0f req-657df0c2-4edf-4880-afc9-1481da4366a1 tempest-TestShelveInstance-247392491 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:59:16.037412 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-e7f526ff-eaf4-44b3-b937-127f7f586e0f req-657df0c2-4edf-4880-afc9-1481da4366a1 tempest-TestShelveInstance-247392491 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.642s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:59:16.038171 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-e7f526ff-eaf4-44b3-b937-127f7f586e0f req-657df0c2-4edf-4880-afc9-1481da4366a1 tempest-TestShelveInstance-247392491 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 21:59:16.065057 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-e7f526ff-eaf4-44b3-b937-127f7f586e0f req-657df0c2-4edf-4880-afc9-1481da4366a1 tempest-TestShelveInstance-247392491 None] Connection info returned from driver {'name': 'volumes/volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f8eb5fa9-3176-4f53-a30e-f79538bc14be'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 21:59:16.116219 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-e7f526ff-eaf4-44b3-b937-127f7f586e0f req-657df0c2-4edf-4880-afc9-1481da4366a1 tempest-TestShelveInstance-247392491 None] attachment_update completed successfully. Jun 04 21:59:26.114895 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=27,cinder:UPDATE=5,cinder:INSERT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:46.141625 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 21:59:46.142536 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:59:46.169918 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 21:59:46.195695 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 21:59:46.323644 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=30,cinder:UPDATE=5,cinder:INSERT=7,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:56.320952 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:00:16.334428 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:00:26.332022 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:00:46.142698 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:00:46.143500 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:00:46.171623 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:00:46.193799 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:00:56.342410 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:01:06.336585 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:01:36.337148 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:01:46.139327 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:01:46.140570 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:01:46.171587 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:01:46.197805 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:01:46.338620 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:01:46.431481 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-fbba862f-0eff-4437-a142-68272358e44b req-2a010b8d-4a8d-40b6-a97a-b367e21650b1 tempest-TestShelveInstance-247392491 None] Terminate volume connection completed successfully. Jun 04 22:01:46.432062 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-fbba862f-0eff-4437-a142-68272358e44b req-2a010b8d-4a8d-40b6-a97a-b367e21650b1 tempest-TestShelveInstance-247392491 None] Deleting attachment f8eb5fa9-3176-4f53-a30e-f79538bc14be. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 22:01:53.395939 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-554028de-4a46-454f-96c8-0a21001b09e2 req-6c7b058b-3d53-4ef6-863b-98d8717b541b tempest-TestShelveInstance-247392491 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 22:01:54.020849 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_concurrency.processutils [req-554028de-4a46-454f-96c8-0a21001b09e2 req-6c7b058b-3d53-4ef6-863b-98d8717b541b tempest-TestShelveInstance-247392491 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.625s {{(pid=130490) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 22:01:54.021683 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-554028de-4a46-454f-96c8-0a21001b09e2 req-6c7b058b-3d53-4ef6-863b-98d8717b541b tempest-TestShelveInstance-247392491 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd8ae048c-c0fd-42d9-9cc3-0736d027658d', 'volume_id': '3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'discard': True}} {{(pid=130490) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} Jun 04 22:01:54.051897 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-554028de-4a46-454f-96c8-0a21001b09e2 req-6c7b058b-3d53-4ef6-863b-98d8717b541b tempest-TestShelveInstance-247392491 None] Connection info returned from driver {'name': 'volumes/volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3d9187db-b18d-4cfa-908b-ff26cf626c2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f7f7b257-4d0e-429f-a578-8421e99dbd3a'} {{(pid=130490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4828}} Jun 04 22:01:54.109826 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-554028de-4a46-454f-96c8-0a21001b09e2 req-6c7b058b-3d53-4ef6-863b-98d8717b541b tempest-TestShelveInstance-247392491 None] attachment_update completed successfully. Jun 04 22:02:16.340983 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:02:26.344418 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=20,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:02:46.145421 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:02:46.146498 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:02:46.177689 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:02:46.204692 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:02:56.343135 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:06.353864 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=2,cinder:SELECT=6 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:29.317194 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:29.329356 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-7ce75bba-b8da-4a2d-89dd-13caea2f8bf1 tempest-TestShelveInstance-247392491 None] Terminate volume connection completed successfully. Jun 04 22:03:29.329772 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.manager [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-7ce75bba-b8da-4a2d-89dd-13caea2f8bf1 tempest-TestShelveInstance-247392491 None] Deleting attachment f7f7b257-4d0e-429f-a578-8421e99dbd3a. {{(pid=130490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4959}} Jun 04 22:03:29.463999 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] Lock "b'cinder-3d9187db-b18d-4cfa-908b-ff26cf626c2a-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jun 04 22:03:29.500396 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:03:29.579282 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] volume has no backup snaps {{(pid=130490) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} Jun 04 22:03:29.590445 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] deleting rbd volume volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} Jun 04 22:03:29.876424 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] volume is a clone so cleaning references {{(pid=130490) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} Jun 04 22:03:29.909394 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] deleting parent snapshot volume-3d9187db-b18d-4cfa-908b-ff26cf626c2a.clone_snap {{(pid=130490) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} Jun 04 22:03:30.542808 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.quota [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] Created reservations ['7cfc5ca3-696e-4bdb-b6ea-db4e90054c37', 'dddb593c-ad1d-49f1-986d-89eb888f4bf3', '3fcf994e-dafa-4487-88a3-3cb05f1cb3e1', '1bc9de66-7b60-45a1-9f42-ee7129116a2d'] {{(pid=130490) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 04 22:03:30.595593 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:03:30.619398 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:03:30.643006 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:03:30.647723 ncdv-master-1 cinder-volume[130490]: INFO cinder.volume.manager [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] Deleted volume successfully. Jun 04 22:03:30.662406 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.coordination [req-37b33425-25b9-4a70-af06-22fc1fe1a973 req-dea453fb-781c-41ee-83aa-ef9eb49b65fd tempest-TestShelveInstance-247392491 None] Lock "b'cinder-3d9187db-b18d-4cfa-908b-ff26cf626c2a-delete_volume'" released by "delete_volume" :: held 1.198s {{(pid=130490) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jun 04 22:03:46.150675 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:03:46.152412 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:03:46.182476 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:03:46.219241 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:03:46.351431 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=18,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:04:06.348139 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:04:06.351888 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:04:16.387285 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:04:46.154652 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:04:46.155358 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:04:46.179430 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:04:46.202209 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:04:56.356405 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:04:56.357790 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=1,cinder:SELECT=5 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:05:36.362802 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:05:36.367065 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:05:46.158213 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:05:46.158875 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:05:46.182333 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:05:46.204789 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:06:06.368112 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:06.383704 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:46.161092 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:06:46.161817 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:06:46.190452 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:06:46.213700 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:06:46.361465 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:56.359029 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:07:16.364043 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:07:26.368577 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:07:46.159881 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:07:46.160521 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:07:46.184103 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:07:46.207696 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:07:56.361223 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:06.365688 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:16.380471 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:46.358442 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:56.354823 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:09:26.366736 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:09:26.377654 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:09:46.164960 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:09:46.165625 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:09:46.195995 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:09:46.220614 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:09:46.368125 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:10:06.371774 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:10:16.378606 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:10:26.379007 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:10:46.166668 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:10:46.167393 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:10:46.196216 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:10:46.220948 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:10:56.372461 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:11:06.375015 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:11:36.379368 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:11:46.171038 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:11:46.171953 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:11:46.195025 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:11:46.219578 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:11:46.377825 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:12:16.374332 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:12:26.375684 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:12:46.175398 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:12:46.176253 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:12:46.204314 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:12:46.227061 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:12:56.378350 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:13:06.380652 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:13:26.384125 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:13:46.173536 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:13:46.174774 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:13:46.210160 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:13:46.232865 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:13:46.382609 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:13:56.396176 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:14:16.391570 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:14:36.388144 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:14:46.179210 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:14:46.180277 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:14:46.214463 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:14:46.241361 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:14:56.384680 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:15:16.386636 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:15:36.396206 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:15:46.178144 ncdv-master-1 cinder-volume[130490]: DEBUG oslo_service.periodic_task [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130490) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 04 22:15:46.179243 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:15:46.204490 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.volume.drivers.rbd [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130490) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} Jun 04 22:15:46.231652 ncdv-master-1 cinder-volume[130490]: DEBUG cinder.manager [None req-0c2c30a4-b4e5-4e6d-b2c8-1334fdbcd71a None None] Notifying Schedulers of capabilities ... {{(pid=130490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 22:15:56.385760 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:16:16.382482 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:16:36.384987 ncdv-master-1 cinder-volume[130490]: DEBUG dbcounter [-] [130490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}