-- Logs begin at Sat 2022-10-22 20:01:24 UTC, end at Sat 2022-10-22 22:43:42 UTC. -- Oct 22 20:38:59.890925 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Oct 22 20:39:02.924782 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=131461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 20:39:02.925655 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=131461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 20:39:02.925655 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=131461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 20:39:03.332560 ncdv-master-1 cinder-volume[131461]: INFO dbcounter [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Registered counter for database cinder Oct 22 20:39:03.352686 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_db.sqlalchemy.engines [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:39:03.359368 ncdv-master-1 cinder-volume[131461]: DEBUG dbcounter [-] [131461] Writer thread running {{(pid=131461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:39:03.656131 ncdv-master-1 cinder-volume[131461]: INFO cinder.rpc [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Oct 22 20:39:03.661182 ncdv-master-1 cinder-volume[131461]: INFO cinder.rpc [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Oct 22 20:39:03.668853 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_db.sqlalchemy.engines [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:39:03.737856 ncdv-master-1 cinder-volume[131461]: INFO cinder.volume.manager [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Determined volume DB was empty at startup. Oct 22 20:39:03.738696 ncdv-master-1 cinder-volume[131461]: DEBUG cinder.volume.manager [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=131461) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Oct 22 20:39:03.747894 ncdv-master-1 cinder-volume[131461]: INFO cinder.volume.manager [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Service not found for updating active_backend_id, assuming default for driver init. Oct 22 20:39:03.748687 ncdv-master-1 cinder-volume[131461]: WARNING stevedore.named [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Oct 22 20:39:03.749137 ncdv-master-1 cinder-volume[131461]: WARNING castellan.key_manager [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Oct 22 20:39:03.750255 ncdv-master-1 cinder-volume[131461]: WARNING cinder.keymgr.conf_key_mgr [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Oct 22 20:39:03.768657 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_db.sqlalchemy.engines [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:39:03.773452 ncdv-master-1 cinder-volume[131461]: INFO cinder.rpc [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Oct 22 20:39:03.778195 ncdv-master-1 cinder-volume[131461]: INFO cinder.rpc [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Oct 22 20:39:03.778877 ncdv-master-1 cinder-volume[131461]: WARNING stevedore.named [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Oct 22 20:39:03.779328 ncdv-master-1 cinder-volume[131461]: WARNING castellan.key_manager [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Oct 22 20:39:03.781078 ncdv-master-1 cinder-volume[131461]: INFO cinder.volume.manager [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Image-volume cache enabled for host ncdv-master-1@ceph. Oct 22 20:39:03.787728 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_db.sqlalchemy.engines [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:39:03.806417 ncdv-master-1 cinder-volume[131461]: INFO oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Starting 1 workers Oct 22 20:39:03.811755 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Started child 131630 {{(pid=131461) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Oct 22 20:39:03.813040 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Full set of CONF: {{(pid=131461) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Oct 22 20:39:03.813572 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ******************************************************************************** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 20:39:03.814039 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] Configuration options gathered from: {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 20:39:03.814556 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 20:39:03.815291 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 20:39:03.815763 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ================================================================================ {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 20:39:03.816631 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] allow_availability_zone_fallback = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.817197 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] allow_compression_on_image_upload = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.817691 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] allowed_direct_url_schemes = [] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.818075 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] api_rate_limit = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.818540 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] auth_strategy = keystone {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.818945 ncdv-master-1 cinder-volume[131630]: INFO cinder.service [-] Starting cinder-volume node (version 21.1.0) Oct 22 20:39:03.819537 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] az_cache_duration = 3600 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.819537 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_availability_zone = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.819891 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_host = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.820412 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_name = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.820987 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_stats_polling_interval = 60 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.821670 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backup_api_class = cinder.backup.api.API {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.822166 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.822586 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backup_name_template = backup-%s {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.822985 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backup_use_same_host = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.823560 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backup_use_temp_snapshot = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.824129 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] chap_password = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.824670 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] chap_username = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.825237 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.825814 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cinder_internal_tenant_project_id = ac7eea49721840f28b9eb3abbd4626f7 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.826357 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cinder_internal_tenant_user_id = ff76f25146cb4de383ef57581917d429 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.826868 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cloned_volume_same_az = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.827425 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cluster = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.827972 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] compression_format = gzip {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.828548 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] compute_api_class = cinder.compute.nova.API {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.829182 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] config_dir = [] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.829529 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.830044 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] config_source = [] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.830425 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.830851 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] control_exchange = openstack {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.831295 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] debug = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.831790 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] default_availability_zone = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.832148 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] default_group_type = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.832705 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.833458 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] default_volume_type = ceph {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.833949 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] driver_client_cert = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.834272 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] driver_client_cert_key = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.834646 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] driver_data_namespace = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.835002 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] driver_ssl_cert_path = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.835414 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] driver_ssl_cert_verify = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.835773 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] driver_use_ssl = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.836168 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] enable_force_upload = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.836470 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] enable_new_services = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.837013 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] enable_unsupported_driver = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.837495 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] enabled_backends = ['ceph'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.837877 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] enforce_multipath_for_image_xfer = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.838349 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] filter_function = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.838700 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] glance_api_insecure = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.839109 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] glance_api_servers = ['http://10.222.0.18/image'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.839506 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] glance_api_ssl_compression = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.839846 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] glance_ca_certificates_file = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.840394 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] glance_catalog_info = image:glance:publicURL {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.840766 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] glance_certfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.841263 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.842319 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] glance_keyfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.842706 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] glance_num_retries = 3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.843060 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] glance_request_timeout = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.843433 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] goodness_function = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.843977 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] graceful_shutdown_timeout = 5 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.844533 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] group_api_class = cinder.group.api.API {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.844995 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] host = ncdv-master-1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.845388 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] iet_conf = /etc/iet/ietd.conf {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.845793 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] image_compress_on_upload = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.846167 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] image_conversion_address_space_limit = 1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.846558 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] image_conversion_cpu_limit = 60 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.847098 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.847482 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] image_conversion_disable = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.847839 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] image_upload_use_cinder_backend = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.848179 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] image_upload_use_internal_tenant = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.848741 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] image_volume_cache_enabled = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.849069 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] image_volume_cache_max_count = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.849472 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] image_volume_cache_max_size_gb = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.849824 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] init_host_max_objects_retrieval = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.850565 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] instance_format = [instance: %(uuid)s] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.851143 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.851867 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] iscsi_iotype = fileio {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.853166 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] iscsi_secondary_ip_addresses = [] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.853892 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] iscsi_target_flags = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.854459 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] iscsi_write_cache = on {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.855649 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] iser_helper = tgtadm {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.856490 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] iser_ip_address = 10.222.0.18 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.857152 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] iser_port = 3260 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.857739 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.858311 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] log_config_append = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.858876 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.859461 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] log_dir = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.860065 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] log_file = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.860581 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] log_options = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.861163 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] log_rotate_interval = 1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.861761 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] log_rotate_interval_type = days {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.862408 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] log_rotation_type = none {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.862902 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.863401 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.863963 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.864527 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.865007 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.865578 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] max_age = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.866121 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] max_logfile_count = 30 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.866687 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] max_logfile_size_mb = 200 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.867270 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] max_over_subscription_ratio = 20.0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.867890 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] message_reap_interval = 86400 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.868500 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Starting volume driver RBDDriver (1.3.0) Oct 22 20:39:03.869017 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] message_ttl = 2592000 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.869579 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] migration_create_volume_timeout_secs = 300 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.870182 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] monkey_patch = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.870709 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] monkey_patch_modules = [] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.871172 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] my_ip = 10.222.0.18 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.871555 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] no_snapshot_gb_quota = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.871910 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] num_iser_scan_tries = 3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.872381 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:39:03.872499 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] num_shell_tries = 3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.872758 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] num_volume_device_scan_tries = 3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.873115 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] nvmet_ns_id = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.873470 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] nvmet_port_id = 1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.873876 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] osapi_max_limit = 1000 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.874271 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] osapi_volume_ext_list = [] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.874689 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.875053 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] osapi_volume_listen = 0.0.0.0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.875452 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] osapi_volume_listen_port = 8776 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.875829 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] osapi_volume_use_ssl = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.876215 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] osapi_volume_workers = 2 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.876572 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] per_volume_size_limit = -1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.876921 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] periodic_fuzzy_delay = 60 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.877286 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] periodic_interval = 60 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.877688 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] project_id_regex = [0-9a-f\-]+ {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.878035 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] public_endpoint = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.878492 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] publish_errors = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.878872 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] quota_backup_gigabytes = 1000 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.879239 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] quota_backups = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.879618 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] quota_consistencygroups = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.880003 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.880368 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] quota_gigabytes = 1000 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.880718 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] quota_groups = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.881087 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] quota_snapshots = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.881462 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] quota_volumes = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.881815 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] rate_limit_burst = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.882179 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] rate_limit_except_level = CRITICAL {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.882542 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] rate_limit_interval = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.882914 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] reinit_driver_count = 3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.883292 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] replication_device = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.883668 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] report_discard_supported = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.884012 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] report_interval = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.884564 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] reservation_clean_interval = 86400 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.884930 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] reservation_expire = 86400 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.885376 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] reserved_percentage = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.885769 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.886131 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.886535 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] rpc_response_timeout = 120 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.886894 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] run_external_periodic_tasks = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.887259 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.887643 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] scst_target_driver = iscsi {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.887995 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] scst_target_iqn_name = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.888289 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] service_down_time = 60 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.888767 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] snapshot_name_template = snapshot-%s {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.889127 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] snapshot_same_host = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.889478 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] split_loggers = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.889772 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] state_path = /opt/stack/data/cinder {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.890138 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] storage_availability_zone = nova {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.890515 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] storage_protocol = iSCSI {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.890981 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] syslog_log_facility = LOG_USER {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.891257 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] target_helper = lioadm {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.892490 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] target_ip_address = 10.222.0.18 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.893023 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] target_port = 3260 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.893389 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.893776 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] target_protocol = iscsi {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.894129 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] trace_flags = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.894482 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] transfer_api_class = cinder.transfer.api.API {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.895072 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] transport_url = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.895487 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] until_refresh = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.896047 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] use_chap_auth = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.896404 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] use_default_quota_class = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.896752 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] use_eventlog = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.897157 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] use_journal = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.897524 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] use_json = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.897871 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] use_multipath_for_image_xfer = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.898216 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] use_stderr = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.898836 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] use_syslog = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.899082 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] verify_glance_signatures = enabled {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.899468 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_api_class = cinder.volume.api.API {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.899816 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_backend_name = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.900386 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_clear = zero {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.900735 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_clear_ionice = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.901105 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_clear_size = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.901475 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.901983 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_copy_bps_limit = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.902502 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_dd_blocksize = 1M {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.903192 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.903738 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_name_template = volume-%s {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.904292 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_service_inithost_offload = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.904811 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volume_usage_audit_period = month {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.906292 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.906750 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] watch_log_file = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.907018 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] zoning_mode = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:39:03.907517 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.908157 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.908655 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.909069 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_concurrency.disable_process_locking = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.909450 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.909855 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.910218 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.910596 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.911003 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.911405 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.911927 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.admin_password = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.912301 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.admin_tenant_name = admin {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.912693 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.admin_token = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.913045 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.admin_user = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.913448 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.auth_admin_prefix = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.913816 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.914191 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.auth_port = 35357 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.914579 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.auth_protocol = https {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.914983 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.auth_section = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.915403 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.auth_type = password {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.915853 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.auth_uri = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.916556 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.auth_version = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.917147 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.cache = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.917461 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.917844 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.certfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.918560 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.delay_auth_decision = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.919585 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.920148 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.http_connect_timeout = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.920753 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.921298 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.identity_uri = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.921822 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.include_service_catalog = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.922343 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.insecure = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.922720 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.interface = public {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.923221 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.keyfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.923639 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.924022 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.924381 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.924744 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.925388 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.925927 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.926123 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.926490 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.926909 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.927460 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.region_name = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.927846 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.928237 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.service_token_roles_required = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.928895 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:39:03.929218 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.service_type = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.929603 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.token_cache_time = 300 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.929980 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] keystone_authtoken.www_authenticate_uri = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.930443 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.backend = dogpile.cache.null {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.930851 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.backend_argument = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.931288 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.config_prefix = cache.oslo {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.931751 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.dead_timeout = 60.0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.932130 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.debug_cache_backend = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.932486 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.enable_retry_client = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.932843 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.enable_socket_keepalive = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.933195 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.enabled = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.933557 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.expiration_time = 600 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.933914 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.hashclient_retry_attempts = 2 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.934274 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.hashclient_retry_delay = 1.0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.934651 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.memcache_dead_retry = 300 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.935017 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.memcache_password = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.935416 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.935783 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.936140 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.memcache_pool_maxsize = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.936493 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.936882 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.memcache_sasl_enabled = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.937264 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.937657 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.memcache_socket_timeout = 1.0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.938043 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.memcache_username = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.938422 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.proxies = [] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.938799 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.retry_attempts = 2 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.939157 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.retry_delay = 0.0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.939549 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.socket_keepalive_count = 1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.939926 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.socket_keepalive_idle = 1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.940279 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.socket_keepalive_interval = 1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.940636 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.tls_allowed_ciphers = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.941034 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.tls_cafile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.941375 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.tls_certfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.941735 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.tls_enabled = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.942097 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cache.tls_keyfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.942496 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] coordination.backend_url = etcd3+http://10.222.0.18:2379 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.942935 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.backend = sqlalchemy {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.943246 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.connection = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.943673 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.connection_debug = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.944038 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.connection_parameters = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.944414 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.connection_recycle_time = 3600 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.944774 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.connection_trace = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.945128 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.db_inc_retry_interval = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.945495 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.db_max_retries = 20 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.945848 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.db_max_retry_interval = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.946216 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.db_retry_interval = 1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.946575 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.max_overflow = 50 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.947120 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.max_pool_size = 5 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.947606 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.max_retries = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.948042 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.mysql_enable_ndb = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.948400 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.949948 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.pool_timeout = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.950938 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.retry_interval = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.951323 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.slave_connection = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.951725 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.sqlite_synchronous = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.952091 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] database.use_db_reconnect = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.952499 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_policy.enforce_new_defaults = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.952854 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_policy.enforce_scope = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.953235 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_policy.policy_default_rule = default {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.953621 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.954020 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_policy.policy_file = policy.yaml {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.954429 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.954777 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.955152 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.955528 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.955914 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.956348 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] profiler.connection_string = messaging:// {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.956644 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] profiler.enabled = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.957016 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] profiler.es_doc_type = notification {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.957373 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] profiler.es_scroll_size = 10000 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.957739 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] profiler.es_scroll_time = 2m {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.958127 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] profiler.filter_error_trace = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.958506 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] profiler.hmac_keys = SECRET_KEY {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.958874 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] profiler.sentinel_service_name = mymaster {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.959286 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] profiler.socket_timeout = 0.1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.960029 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] profiler.trace_sqlalchemy = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.960474 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] privsep_osbrick.capabilities = [21] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.960865 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] privsep_osbrick.group = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.961217 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] privsep_osbrick.helper_command = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.961589 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.962144 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.962591 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] privsep_osbrick.user = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.963013 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.963381 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cinder_sys_admin.group = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.963778 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cinder_sys_admin.helper_command = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.964148 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.964512 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.964884 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] cinder_sys_admin.user = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.965267 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] service_user.auth_section = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.965624 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] service_user.auth_type = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.965973 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] service_user.cafile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.966318 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] service_user.certfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.966704 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] service_user.collect_timing = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.967053 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] service_user.insecure = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.967461 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] service_user.keyfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.967845 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] service_user.send_service_user_token = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.968222 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] service_user.split_loggers = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.968573 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] service_user.timeout = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.969007 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.backend_availability_zone = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.969367 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.969727 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.970100 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.chap_password = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.970464 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.chap_username = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.970839 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.971203 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.971664 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.972028 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.driver_client_cert = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.974933 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.driver_client_cert_key = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.975367 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.driver_data_namespace = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.976099 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.976567 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.977270 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.driver_use_ssl = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.977651 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.enable_deferred_deletion = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.978083 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.enable_unsupported_driver = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.978557 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.978945 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.extra_capabilities = {} {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.979315 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.filter_function = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.979698 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.goodness_function = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.980072 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.980453 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.980818 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.981177 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.981557 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.981929 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.982283 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.iscsi_iotype = fileio {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.982645 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.983014 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.iscsi_target_flags = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.983434 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.iscsi_write_cache = on {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.983815 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.iser_helper = tgtadm {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.984362 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.iser_ip_address = 10.222.0.18 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.984724 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.iser_port = 3260 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.985092 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.985472 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.985832 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.986207 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.num_shell_tries = 3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.986564 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.986931 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.987290 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.nvmet_port_id = 1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.987708 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rados_connect_timeout = -1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.988273 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rados_connection_interval = 5 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.988852 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rados_connection_retries = 3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.989466 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rbd_ceph_conf = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.990081 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rbd_cluster_name = ceph {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.990649 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.991230 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.991840 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.992456 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rbd_pool = rbd {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.992888 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rbd_secret_uuid = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.993274 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.993632 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.rbd_user = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.994128 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.replication_connect_timeout = 5 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.994495 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.replication_device = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.994941 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.report_discard_supported = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.995216 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.995599 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.reserved_percentage = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.995976 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.scst_target_driver = iscsi {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.996332 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.scst_target_iqn_name = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.996698 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.storage_protocol = iSCSI {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.997055 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.997431 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.target_helper = tgtadm {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.997933 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.target_ip_address = 10.222.0.18 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.998294 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.target_port = 3260 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.998684 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.999054 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.target_protocol = iscsi {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.999690 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.trace_flags = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:03.999917 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.unique_fqdn_network = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.000185 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.use_chap_auth = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.000602 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.000883 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.volume_backend_name = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.001826 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.volume_clear = zero {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.002399 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.volume_clear_ionice = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.002943 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.volume_clear_size = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.003539 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.004066 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.004507 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.004850 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.005328 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.005748 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_reports.file_event_handler = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.006425 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.006827 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_reports.log_dir = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.007429 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.backend_availability_zone = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.007794 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.backend_host = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.008321 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.backend_native_threads_pool_size = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.008838 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.backup_use_temp_snapshot = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.009207 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.chap_password = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.009674 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.chap_username = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.010033 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.chiscsi_conf = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.010569 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.deferred_deletion_delay = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.010933 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.deferred_deletion_purge_interval = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.011290 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.driver_client_cert = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.011669 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.driver_client_cert_key = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.012299 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.driver_data_namespace = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.012687 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.driver_ssl_cert_path = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.013236 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.driver_ssl_cert_verify = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.013755 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.driver_use_ssl = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.014111 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.enable_deferred_deletion = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.014646 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.enable_unsupported_driver = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.015186 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.015587 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.extra_capabilities = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.015955 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.filter_function = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.016315 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.goodness_function = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.016712 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.iet_conf = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.017090 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.image_upload_use_cinder_backend = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.017472 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.image_upload_use_internal_tenant = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.017845 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.image_volume_cache_enabled = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.018726 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.image_volume_cache_max_count = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.019089 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.image_volume_cache_max_size_gb = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.019482 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.iscsi_iotype = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.019843 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.020224 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.iscsi_target_flags = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.020565 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.iscsi_write_cache = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.020918 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.iser_helper = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.021289 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.iser_ip_address = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.021645 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.iser_port = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.022001 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.iser_target_prefix = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.022349 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.max_over_subscription_ratio = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.022854 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.num_iser_scan_tries = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.023217 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.num_shell_tries = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.023590 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.num_volume_device_scan_tries = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.024104 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.nvmet_ns_id = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.024468 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.nvmet_port_id = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.024852 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rados_connect_timeout = -1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.025302 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rados_connection_interval = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.025676 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rados_connection_retries = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.026117 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.026478 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rbd_cluster_name = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.026828 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.027390 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.027939 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rbd_max_clone_depth = 5 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.028307 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rbd_pool = volumes {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.028678 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rbd_secret_uuid = 0c6c2c34-73f1-4f49-ac48-3a7235affc01 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.029047 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rbd_store_chunk_size = 4 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.029433 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.rbd_user = cinder {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.029971 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.replication_connect_timeout = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.030501 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.replication_device = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.031021 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.report_discard_supported = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.031383 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.report_dynamic_total_capacity = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.031735 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.reserved_percentage = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.032106 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.scst_target_driver = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.032450 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.scst_target_iqn_name = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.032799 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.storage_protocol = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.033147 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.suppress_requests_ssl_warnings = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.033508 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.target_helper = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.033865 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.target_ip_address = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.034213 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.target_port = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.034565 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.target_prefix = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.034913 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.target_protocol = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.035004 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:39:04.035260 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.trace_flags = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.035673 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.unique_fqdn_network = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.036030 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.use_chap_auth = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.036404 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.use_multipath_for_image_xfer = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.036763 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.volume_backend_name = ceph {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.037110 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.volume_clear = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.037456 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.volume_clear_ionice = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.037798 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.volume_clear_size = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.038326 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.038819 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.volume_copy_bps_limit = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.039201 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.volume_dd_blocksize = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.039616 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.040008 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ceph.volumes_dir = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.040453 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.040892 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.041276 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.041649 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.042037 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.042407 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.042791 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.043145 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.043531 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.043898 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.044280 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.044653 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.045070 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.045460 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.045822 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.046325 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.046815 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.046966 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.047251 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.047635 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.048004 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.048358 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.048893 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.049266 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.049637 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.049994 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.ssl = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.050361 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.050739 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.051087 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.051760 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.051956 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_rabbit.ssl_version = {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.053103 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_notifications.driver = [] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.053103 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_notifications.retry = -1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.053103 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.053547 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] oslo_messaging_notifications.transport_url = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.053707 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.054100 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] key_manager.fixed_key = **** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.054443 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.054443 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.barbican_api_version = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.055327 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.barbican_endpoint = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.055536 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.barbican_endpoint_type = public {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.057553 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.barbican_region_name = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.057553 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.cafile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.057553 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.certfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.057553 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.collect_timing = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.057553 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.insecure = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.057553 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.keyfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.058537 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.number_of_retries = 60 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.058537 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.retry_delay = 1 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.058825 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.send_service_user_token = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.058979 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.split_loggers = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.059584 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.timeout = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.059753 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.verify_ssl = True {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.060036 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican.verify_ssl_path = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.060378 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican_service_user.auth_section = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.060740 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican_service_user.auth_type = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.070139 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican_service_user.cafile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.070594 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican_service_user.certfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.070975 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican_service_user.collect_timing = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.071397 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican_service_user.insecure = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.071725 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican_service_user.keyfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.072150 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican_service_user.split_loggers = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.072643 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] barbican_service_user.timeout = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.073235 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.approle_role_id = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.073802 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.approle_secret_id = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.074182 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.cafile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.074535 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.certfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.074893 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.collect_timing = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.075250 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.insecure = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.075634 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.keyfile = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.076012 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.kv_mountpoint = secret {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.076379 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.kv_version = 2 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.076744 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.namespace = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.077099 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.root_token_id = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.077458 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.split_loggers = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.077819 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.ssl_ca_crt_file = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.078170 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.timeout = None {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.078543 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.use_ssl = False {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.078921 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:39:04.079209 ncdv-master-1 cinder-volume[131461]: DEBUG oslo_service.service [None req-6f8b047e-7eee-4064-af4f-4e0ee4c4cadf None None] ******************************************************************************** {{(pid=131461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 20:39:04.089977 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.driver [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Driver hasn't implemented _init_vendor_properties() Oct 22 20:39:04.090350 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.driver [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:776e93ef-ad06-4c7f-a9fc-b5b546d962a8:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=131630) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}} Oct 22 20:39:04.102771 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_db.sqlalchemy.engines [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:39:04.105178 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writer thread running {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:39:04.136905 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.db.sqlalchemy.api [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Building query based on filter {{(pid=131630) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}} Oct 22 20:39:04.158130 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.image_utils [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=131630) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:991}} Oct 22 20:39:04.167827 ncdv-master-1 cinder-volume[131630]: INFO cinder.keymgr.migration [None req-5cfaee06-03d8-43a2-add5-40d2b443a010 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Oct 22 20:39:04.171627 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:39:04.202353 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:39:04.237411 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:39:04.269149 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Driver initialization completed successfully. Oct 22 20:39:04.269972 ncdv-master-1 cinder-volume[131630]: INFO cinder.manager [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Initiating service 3 cleanup Oct 22 20:39:04.279797 ncdv-master-1 cinder-volume[131630]: INFO cinder.manager [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Service 3 cleanup completed. Oct 22 20:39:04.280248 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.service [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Creating RPC server for service cinder-volume {{(pid=131630) start /opt/stack/cinder/cinder/service.py:238}} Oct 22 20:39:04.288823 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.service [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=131630) start /opt/stack/cinder/cinder/service.py:244}} Oct 22 20:39:04.340349 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Initializing RPC dependent components of volume driver RBDDriver (1.3.0) Oct 22 20:39:04.341381 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:39:04.376308 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:39:04.426720 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-823f488c-7ea4-470e-98dc-0b289bc5b747 None None] Driver post RPC initialization completed successfully. Oct 22 20:39:13.799871 ncdv-master-1 cinder-volume[131461]: DEBUG dbcounter [-] [131461] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=131461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:14.410286 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=18,cinder:INSERT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:14.421803 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:34.434611 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:44.439224 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:40:04.447779 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:40:24.438315 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:40:30.429526 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:40:30.430348 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:40:30.455235 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:40:30.480734 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:40:34.450724 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:40:44.446935 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:41:04.452110 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:41:14.453235 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:41:30.426321 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:41:30.426995 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:41:30.456195 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:41:30.481334 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:41:34.463067 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:41:44.467174 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:04.468051 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:14.477720 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:30.426952 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:42:30.427689 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:42:30.451376 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:42:30.474812 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:42:34.475067 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:34.480806 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:54.484005 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:54.484950 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:43:30.431016 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:43:30.432314 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:43:30.464589 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:43:30.488865 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:43:34.480825 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:43:34.482807 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:44:04.489155 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:44:04.499871 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:44:24.496802 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:44:30.434334 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:44:30.435052 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:44:30.459765 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:44:30.490515 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:44:44.498862 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:45:04.500079 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:45:24.498962 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:45:30.436424 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:45:30.437568 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:45:30.465270 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:45:30.489613 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:45:34.511530 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:45:54.506939 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:46:14.507262 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:46:30.435833 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:46:30.436959 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:46:30.467151 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:46:30.491841 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:46:34.506390 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:46:34.509196 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:14.500385 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:14.502993 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:30.437435 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:47:30.438551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:47:30.475586 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:47:30.508135 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:47:34.503742 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:54.508652 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:54.510195 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:14.506517 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:24.516393 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:30.433974 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:48:30.435452 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:48:30.515217 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:48:30.578205 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:48:34.559545 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:54.534853 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:04.519202 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:24.536779 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:30.438519 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:49:30.439383 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:49:30.499370 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:49:30.558781 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:49:54.508569 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:04.509570 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:14.516716 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:23.265115 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:50:23.387857 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Flow 'volume_create_manager' (f7f5758c-dff8-4a5e-8e62-a4baca9452ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:50:23.420909 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09ab01d-21b0-467b-bcee-7a807dd09dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:50:23.545073 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09ab01d-21b0-467b-bcee-7a807dd09dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1019099955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b19f74cf-0ef6-4650-adc9-cd75d82fe224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598f129979a34e7a856b83bd0e69f1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T20:50:23Z,use_quota=True,user_id='6da7143c3bfb46a7b193a8d96f1b75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:50:23.551830 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1d522a-1998-4ea6-a5f6-faec53cf7881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:50:23.556241 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1d522a-1998-4ea6-a5f6-faec53cf7881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:50:23.564467 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02fc827-3409-4ae7-ad6e-4aa9c045c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:50:23.724609 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02fc827-3409-4ae7-ad6e-4aa9c045c054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b19f74cf-0ef6-4650-adc9-cd75d82fe224', 'volume_name': 'volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:50:23.733155 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34265219-d5f6-428c-8fe6-189f223f9d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:50:23.750746 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34265219-d5f6-428c-8fe6-189f223f9d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:50:23.761711 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fd4fb5-f110-45c3-bdb3-91906fbaad40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:50:23.763069 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Volume b19f74cf-0ef6-4650-adc9-cd75d82fe224: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 20:50:23.763688 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Cloning b19f74cf-0ef6-4650-adc9-cd75d82fe224 from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 20:50:23.764593 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:50:23.784634 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:50:23.803204 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Preparing cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}} Oct 22 20:50:23.804342 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 20:50:30.444668 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:50:30.446370 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:50:30.520845 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:50:30.594099 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:50:33.810099 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:44.497523 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:45.558612 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.image_utils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph, size 616.00 MB, duration 21.74 sec {{(pid=131630) fetch /opt/stack/cinder/cinder/image/image_utils.py:587}} Oct 22 20:50:45.559333 ncdv-master-1 cinder-volume[131630]: INFO cinder.image.image_utils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Image download 616.00 MB at 28.33 MB/s Oct 22 20:50:45.625244 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:50:45.904609 ncdv-master-1 sudo[142647]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph Oct 22 20:50:45.905820 ncdv-master-1 sudo[142647]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 22 20:50:48.927800 ncdv-master-1 sudo[142647]: pam_unix(sudo:session): session closed for user root Oct 22 20:50:48.931200 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph" returned: 0 in 3.305s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:50:48.932760 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.image_utils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Temporary image 085e4478-6edc-4a69-8e08-f9831713eb65 is fetched for user 6da7143c3bfb46a7b193a8d96f1b75b2. {{(pid=131630) fetch /opt/stack/cinder/cinder/image/image_utils.py:1124}} Oct 22 20:50:49.095134 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:50:49.421971 ncdv-master-1 sudo[142657]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph Oct 22 20:50:49.423015 ncdv-master-1 sudo[142657]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 22 20:50:52.255596 ncdv-master-1 sudo[142657]: pam_unix(sudo:session): session closed for user root Oct 22 20:50:52.257874 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph" returned: 0 in 3.163s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:50:52.259398 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] creating volume 'volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 20:50:52.261308 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:50:52.463773 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:50:52.464317 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:50:52.501288 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Attempting download of 085e4478-6edc-4a69-8e08-f9831713eb65 ((None, None)) to volume b19f74cf-0ef6-4650-adc9-cd75d82fe224. {{(pid=131630) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Oct 22 20:50:52.572592 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_085e4478-6edc-4a69-8e08-f9831713eb65_m0znu_yd {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:50:52.680344 ncdv-master-1 sudo[142750]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_085e4478-6edc-4a69-8e08-f9831713eb65_m0znu_yd Oct 22 20:50:52.681764 ncdv-master-1 sudo[142750]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 22 20:50:53.937881 ncdv-master-1 sudo[142750]: pam_unix(sudo:session): session closed for user root Oct 22 20:50:53.940614 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_085e4478-6edc-4a69-8e08-f9831713eb65_m0znu_yd" returned: 0 in 1.368s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:50:53.942897 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:50:54.062822 ncdv-master-1 sudo[142766]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph Oct 22 20:50:54.064421 ncdv-master-1 sudo[142766]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 22 20:50:55.438533 ncdv-master-1 sudo[142766]: pam_unix(sudo:session): session closed for user root Oct 22 20:50:55.442195 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph" returned: 0 in 1.499s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:50:55.443508 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.image_utils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] 085e4478-6edc-4a69-8e08-f9831713eb65 was vhdx, converting to raw {{(pid=131630) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:825}} Oct 22 20:50:55.444815 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp56mzfjm7 {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:50:55.472661 ncdv-master-1 sudo[142778]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp56mzfjm7 Oct 22 20:50:55.474282 ncdv-master-1 sudo[142778]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 22 20:50:58.357895 ncdv-master-1 sudo[142778]: pam_unix(sudo:session): session closed for user root Oct 22 20:50:58.360566 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp56mzfjm7" returned: 0 in 2.915s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:50:58.361584 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:50:58.496875 ncdv-master-1 sudo[142793]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph Oct 22 20:50:58.497710 ncdv-master-1 sudo[142793]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 22 20:50:59.868879 ncdv-master-1 sudo[142793]: pam_unix(sudo:session): session closed for user root Oct 22 20:50:59.871261 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph" returned: 0 in 1.509s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:50:59.872312 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.image_utils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_085e4478-6edc-4a69-8e08-f9831713eb65_bhrpmaq9ncdv-master-1@ceph, size 700.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/conversion/tmp56mzfjm7 {{(pid=131630) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:419}} Oct 22 20:50:59.872696 ncdv-master-1 cinder-volume[131630]: INFO cinder.image.image_utils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Converted 700.00 MB image at 240.00 MB/s Oct 22 20:50:59.874198 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:51:00.027926 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 20:51:00.039493 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 20:51:00.066711 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] deleting rbd volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 20:51:00.418640 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp56mzfjm7 volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:51:04.509375 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:05.174848 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp56mzfjm7 volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 4.756s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:51:05.316136 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:51:05.465268 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:51:05.465651 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:51:05.466342 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Downloaded image 085e4478-6edc-4a69-8e08-f9831713eb65 ((None, None)) to volume b19f74cf-0ef6-4650-adc9-cd75d82fe224 successfully. {{(pid=131630) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}} Oct 22 20:51:05.553936 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.image_utils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Temporary image 085e4478-6edc-4a69-8e08-f9831713eb65 for user 6da7143c3bfb46a7b193a8d96f1b75b2 is deleted. {{(pid=131630) fetch /opt/stack/cinder/cinder/image/image_utils.py:1128}} Oct 22 20:51:05.615819 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Oct 22 20:51:05.616696 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Oct 22 20:51:05.805557 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Created reservations ['6fd3cad9-599f-49dd-b6a5-684f00321af6', '5a6d7a65-ba4f-4e4c-b8d0-3f07637c0c2a', '9f91c2e2-f8ff-4a97-a2e0-30bdd6f8e887', 'f71f327b-f511-4be7-85c0-0d45ba60827c'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 20:51:05.833902 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Creating image volume entry: {'consistencygroup_id': None, 'metadata': {}, 'bootable': False, 'provider_geometry': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'group_id': None, 'provider_auth': None, 'volume_metadata': [], 'provider_id': None, 'availability_zone': 'nova', 'service_uuid': None, 'replication_driver_data': None, 'display_description': None, 'launched_at': None, 'replication_status': None, 'deleted_at': None, 'size': 1, 'display_name': 'image-085e4478-6edc-4a69-8e08-f9831713eb65', 'user_id': '6da7143c3bfb46a7b193a8d96f1b75b2', 'cluster_name': None, 'ec2_id': None, 'shared_targets': True, 'volume_admin_metadata': [], 'created_at': datetime.datetime(2022, 10, 22, 20, 50, 22, tzinfo=datetime.timezone.utc), 'volume_type_id': 'dab03be6-f5a0-454c-bdd5-705b7c298774', 'provider_location': None, 'scheduled_at': datetime.datetime(2022, 10, 22, 20, 50, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 50, 23, tzinfo=datetime.timezone.utc), 'replication_extended_status': None, 'previous_status': None, 'host': 'ncdv-master-1@ceph#ceph', 'multiattach': False, 'encryption_key_id': None, 'deleted': False, 'terminated_at': None, 'project_id': 'ac7eea49721840f28b9eb3abbd4626f7', 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'b19f74cf-0ef6-4650-adc9-cd75d82fe224'}. {{(pid=131630) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}} Oct 22 20:51:06.022693 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Volume reschedule parameters: False retry: None {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:51:06.069242 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Flow 'volume_create_manager' (17795b10-599a-48b0-a026-1c53c5d7de8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:51:06.092099 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91aa4a2c-d608-42d5-863e-9c9ed66ff0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:06.133725 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91aa4a2c-d608-42d5-863e-9c9ed66ff0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='image-085e4478-6edc-4a69-8e08-f9831713eb65',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7eea49721840f28b9eb3abbd4626f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b19f74cf-0ef6-4650-adc9-cd75d82fe224,status='creating',terminated_at=None,updated_at=2022-10-22T20:50:23Z,use_quota=True,user_id='6da7143c3bfb46a7b193a8d96f1b75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:06.142965 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2218e8-d5fa-450a-b42a-9a2624719cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:06.152510 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2218e8-d5fa-450a-b42a-9a2624719cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:06.161117 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713340d4-f5cc-435a-b2b3-bec3623b41a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:06.196746 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713340d4-f5cc-435a-b2b3-bec3623b41a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'volume_name': 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'volume_size': 1, 'source_volid': 'b19f74cf-0ef6-4650-adc9-cd75d82fe224', 'source_volstatus': 'downloading'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:06.208486 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666edd74-c690-4fe4-b144-89e3a896e1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:06.212425 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666edd74-c690-4fe4-b144-89e3a896e1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:06.237324 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca703065-c8de-448d-96e6-95d792f216cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:06.238421 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'volume_size': 1, 'source_volid': 'b19f74cf-0ef6-4650-adc9-cd75d82fe224', 'source_volstatus': 'downloading'} Oct 22 20:51:06.254360 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:51:06.351446 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] creating snapshot='volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 20:51:07.280244 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] cloning 'volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224@volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf.clone_snap' to 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 20:51:07.439007 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 20:51:07.440727 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:51:07.441319 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:51:07.470373 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 20:51:07.473991 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca703065-c8de-448d-96e6-95d792f216cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'volume_size': 1, 'source_volid': 'b19f74cf-0ef6-4650-adc9-cd75d82fe224', 'source_volstatus': 'downloading'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:07.489605 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5663cfe-5d57-40d3-a599-0de009aa3e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:07.506044 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Volume volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf (3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf): created successfully Oct 22 20:51:07.510655 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5663cfe-5d57-40d3-a599-0de009aa3e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:07.518584 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Flow 'volume_create_manager' (17795b10-599a-48b0-a026-1c53c5d7de8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:51:07.532381 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Created volume successfully. Oct 22 20:51:07.584363 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Creating new image-volume cache entry for image 085e4478-6edc-4a69-8e08-f9831713eb65 on ncdv-master-1@ceph#ceph {{(pid=131630) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Oct 22 20:51:07.598858 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] New image-volume cache entry created: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 20, 51, 7, 589052)}. {{(pid=131630) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Oct 22 20:51:07.605642 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 43.822s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:51:07.607262 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Marking volume b19f74cf-0ef6-4650-adc9-cd75d82fe224 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 20:51:07.638484 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to b19f74cf-0ef6-4650-adc9-cd75d82fe224. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 20:51:07.639553 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Creating volume glance metadata for volume b19f74cf-0ef6-4650-adc9-cd75d82fe224 backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 20:51:07.732873 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fd4fb5-f110-45c3-bdb3-91906fbaad40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:07.746007 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2effd3cc-7c7b-472e-ad23-11f02e6704c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:07.764179 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224 (b19f74cf-0ef6-4650-adc9-cd75d82fe224): created successfully Oct 22 20:51:07.769608 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2effd3cc-7c7b-472e-ad23-11f02e6704c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:07.802939 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Flow 'volume_create_manager' (f7f5758c-dff8-4a5e-8e62-a4baca9452ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:51:07.829733 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-032836f2-feb7-49ab-9c58-32836b5545e5 tempest-ServersTestBootFromVolume-802420894 None] Created volume successfully. Oct 22 20:51:13.688062 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc req-86bbd4c4-747d-44b0-b562-0a4df0803d09 tempest-ServersTestBootFromVolume-802420894 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:51:14.867648 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc req-86bbd4c4-747d-44b0-b562-0a4df0803d09 tempest-ServersTestBootFromVolume-802420894 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.179s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:51:14.869338 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc req-86bbd4c4-747d-44b0-b562-0a4df0803d09 tempest-ServersTestBootFromVolume-802420894 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'b19f74cf-0ef6-4650-adc9-cd75d82fe224', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:51:14.872301 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=42,cinder:UPDATE=14,cinder:INSERT=11,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:14.986998 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc req-86bbd4c4-747d-44b0-b562-0a4df0803d09 tempest-ServersTestBootFromVolume-802420894 None] Connection info returned from driver {'name': 'volumes/volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b19f74cf-0ef6-4650-adc9-cd75d82fe224', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5f67e295-649c-4fc3-b4a5-f2c900e54de2'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:51:15.080860 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-39764ac6-cf59-4d8d-901a-1d8492eeb3bc req-86bbd4c4-747d-44b0-b562-0a4df0803d09 tempest-ServersTestBootFromVolume-802420894 None] attachment_update completed successfully. Oct 22 20:51:30.449849 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:51:30.451533 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:51:30.489486 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:51:30.562474 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:51:40.953571 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:51:40.974615 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Flow 'volume_create_manager' (b2914d86-e38d-40c1-a7e7-a6366bae1b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:51:40.982388 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5290a8-3ace-4fde-9a7b-eca5c2bdb5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:41.001336 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5290a8-3ace-4fde-9a7b-eca5c2bdb5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-189343011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=52e959f8-e0fb-44b9-aad5-1abd5310b890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b403b83cad4babab211dafade27bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T20:51:41Z,use_quota=True,user_id='b892876156f34b0d99a6c853d0cd4905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:41.007742 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542802e4-2b2f-48e7-8fd9-f3b7518a779c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:41.011885 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542802e4-2b2f-48e7-8fd9-f3b7518a779c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:41.017728 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aee2066-5ad2-4ddd-8be9-c76ea6b26ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:41.022641 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aee2066-5ad2-4ddd-8be9-c76ea6b26ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e959f8-e0fb-44b9-aad5-1abd5310b890', 'volume_name': 'volume-52e959f8-e0fb-44b9-aad5-1abd5310b890', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:41.027832 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796af091-e7b8-4989-b508-789fced2e14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:41.032376 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796af091-e7b8-4989-b508-789fced2e14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:41.038207 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3761ddf-6d1c-4c58-876e-c72f86209052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:41.039299 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Volume 52e959f8-e0fb-44b9-aad5-1abd5310b890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e959f8-e0fb-44b9-aad5-1abd5310b890', 'volume_size': 1} Oct 22 20:51:41.039741 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] creating volume 'volume-52e959f8-e0fb-44b9-aad5-1abd5310b890' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 20:51:41.040605 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:51:41.104814 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:51:41.105197 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:51:41.108910 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3761ddf-6d1c-4c58-876e-c72f86209052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e959f8-e0fb-44b9-aad5-1abd5310b890', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:41.114125 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c6a49d-d7a2-4d13-9ced-ceaf41f82d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:51:41.119739 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=57,cinder:UPDATE=15,cinder:INSERT=13,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:41.126944 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Volume volume-52e959f8-e0fb-44b9-aad5-1abd5310b890 (52e959f8-e0fb-44b9-aad5-1abd5310b890): created successfully Oct 22 20:51:41.131574 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c6a49d-d7a2-4d13-9ced-ceaf41f82d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:51:41.137772 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Flow 'volume_create_manager' (b2914d86-e38d-40c1-a7e7-a6366bae1b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:51:41.151929 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b275e1ac-ca7f-4c1d-991e-2d71bd301463 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Created volume successfully. Oct 22 20:51:42.756663 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 req-082407b2-3cc7-4a11-b23e-53debe9c5f3c tempest-AttachSCSIVolumeTestJSON-2143007201 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:51:43.683467 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 req-082407b2-3cc7-4a11-b23e-53debe9c5f3c tempest-AttachSCSIVolumeTestJSON-2143007201 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.926s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:51:43.684343 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 req-082407b2-3cc7-4a11-b23e-53debe9c5f3c tempest-AttachSCSIVolumeTestJSON-2143007201 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-52e959f8-e0fb-44b9-aad5-1abd5310b890', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '52e959f8-e0fb-44b9-aad5-1abd5310b890', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:51:43.713864 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 req-082407b2-3cc7-4a11-b23e-53debe9c5f3c tempest-AttachSCSIVolumeTestJSON-2143007201 None] Connection info returned from driver {'name': 'volumes/volume-52e959f8-e0fb-44b9-aad5-1abd5310b890', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '52e959f8-e0fb-44b9-aad5-1abd5310b890', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dafe159b-1976-484a-9ab0-5270bbd259be'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:51:43.772425 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-cd7256ec-1d1c-4837-9da7-67341c1f28f9 req-082407b2-3cc7-4a11-b23e-53debe9c5f3c tempest-AttachSCSIVolumeTestJSON-2143007201 None] attachment_update completed successfully. Oct 22 20:51:51.281555 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=28,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:51.292909 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-6b756c52-0f4b-4bac-adf6-35e73360516a req-5ae67025-544d-48cf-99a9-516c6dbea32e tempest-AttachSCSIVolumeTestJSON-2143007201 None] Terminate volume connection completed successfully. Oct 22 20:51:51.293545 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-6b756c52-0f4b-4bac-adf6-35e73360516a req-5ae67025-544d-48cf-99a9-516c6dbea32e tempest-AttachSCSIVolumeTestJSON-2143007201 None] Deleting attachment dafe159b-1976-484a-9ab0-5270bbd259be. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 20:51:59.056723 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Acquiring lock "cinder-52e959f8-e0fb-44b9-aad5-1abd5310b890-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:51:59.072371 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Lock "cinder-52e959f8-e0fb-44b9-aad5-1abd5310b890-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:51:59.141446 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:51:59.230615 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 20:51:59.231116 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Volume volume-52e959f8-e0fb-44b9-aad5-1abd5310b890 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 20:51:59.241114 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] deleting rbd volume volume-52e959f8-e0fb-44b9-aad5-1abd5310b890 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 20:51:59.659377 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Created reservations ['7577eab1-fabf-4336-82fb-d4de5c3e3988', '1a6d030e-aa56-432c-af8c-640564de1a4c', '1717488e-2433-43c0-b32c-09734a409912', '48342a6e-9918-409d-af83-628626835863'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 20:51:59.717699 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:51:59.747664 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:51:59.774141 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:51:59.779627 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Deleted volume successfully. Oct 22 20:51:59.797103 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4823be66-dd15-4a02-a69f-0cf733455a79 tempest-AttachSCSIVolumeTestJSON-2143007201 None] Lock "cinder-52e959f8-e0fb-44b9-aad5-1abd5310b890-delete_volume" released by "delete_volume" :: held 0.725s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:52:14.496502 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=29,cinder:DELETE=2,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:24.494826 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=18,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:30.448627 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:52:30.450467 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:52:30.546745 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:52:30.626181 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:52:34.509245 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:44.274984 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-c6e0b742-0004-497a-93db-4fc583161811 tempest-ServersTestBootFromVolume-802420894 None] Terminate volume connection completed successfully. Oct 22 20:52:44.275716 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-c6e0b742-0004-497a-93db-4fc583161811 tempest-ServersTestBootFromVolume-802420894 None] Deleting attachment 5f67e295-649c-4fc3-b4a5-f2c900e54de2. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 20:52:44.466352 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:52:44.517261 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Flow 'volume_create_manager' (eb0bf1b1-349e-406f-9109-c48b22b3a783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:52:44.532727 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379ac6b3-b9dc-4c14-89da-3cf37dcc42ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:52:44.559084 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379ac6b3-b9dc-4c14-89da-3cf37dcc42ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1137181319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=58bc667d-d54e-4146-bcf2-33215200e583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48413ed1ac4e1ea65fb38f097881db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T20:52:44Z,use_quota=True,user_id='34f8af8ee2b545bead90fffd6c6c4896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:52:44.566505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d5e372-b3c5-48b7-a091-14f3ea0d23eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:52:44.571674 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d5e372-b3c5-48b7-a091-14f3ea0d23eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:52:44.577149 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14605ee3-6a6b-465e-bc4f-0329c08eeded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:52:44.583849 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14605ee3-6a6b-465e-bc4f-0329c08eeded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58bc667d-d54e-4146-bcf2-33215200e583', 'volume_name': 'volume-58bc667d-d54e-4146-bcf2-33215200e583', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:52:44.590109 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e69fa37-e5f8-4516-8ef8-e5ba144b1c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:52:44.595108 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e69fa37-e5f8-4516-8ef8-e5ba144b1c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:52:44.600179 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de01d8f0-e38b-4b7b-8351-c3c1be7c46d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:52:44.602274 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Volume 58bc667d-d54e-4146-bcf2-33215200e583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58bc667d-d54e-4146-bcf2-33215200e583', 'volume_size': 1} Oct 22 20:52:44.603555 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] creating volume 'volume-58bc667d-d54e-4146-bcf2-33215200e583' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 20:52:44.604796 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:52:44.657473 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] Acquiring lock "cinder-b19f74cf-0ef6-4650-adc9-cd75d82fe224-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:52:44.686729 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] Lock "cinder-b19f74cf-0ef6-4650-adc9-cd75d82fe224-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:52:44.705902 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:52:44.706687 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:52:44.711775 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de01d8f0-e38b-4b7b-8351-c3c1be7c46d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58bc667d-d54e-4146-bcf2-33215200e583', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:52:44.716927 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfda6dac-fa76-4805-89f1-a8f77b421734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:52:44.742714 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Volume volume-58bc667d-d54e-4146-bcf2-33215200e583 (58bc667d-d54e-4146-bcf2-33215200e583): created successfully Oct 22 20:52:44.746858 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfda6dac-fa76-4805-89f1-a8f77b421734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:52:44.753514 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Flow 'volume_create_manager' (eb0bf1b1-349e-406f-9109-c48b22b3a783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:52:44.769751 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7a2a96cb-2d94-403b-a9b2-0b95979f9b30 tempest-VolumesAdminNegativeTest-1470267362 None] Created volume successfully. Oct 22 20:52:44.776031 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:52:44.840574 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 20:52:44.841218 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] volume has clone snapshot(s) {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1378}} Oct 22 20:52:44.842744 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 20:52:44.978894 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] Created reservations ['05c119b8-44f0-4416-aecc-51044f078d19', '1fedaabe-a996-4c8c-af97-e75172a35ab8', '86960011-4423-4f52-8670-a1580e4adf4a', 'ec526dfd-cbef-4fad-a490-ed39eb1dd71c'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 20:52:45.052909 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:52:45.119870 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:52:45.175013 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:52:45.180744 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] Deleted volume successfully. Oct 22 20:52:45.196197 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-b7647ba2-a2de-4534-acb5-c1b5b0b0318d req-83f19685-9022-482a-bc0f-760fca7ee8eb tempest-ServersTestBootFromVolume-802420894 None] Lock "cinder-b19f74cf-0ef6-4650-adc9-cd75d82fe224-delete_volume" released by "delete_volume" :: held 0.510s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:52:46.344881 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 req-ef81db9e-59d6-4357-8a31-149851b7ec2c tempest-VolumesAdminNegativeTest-1470267362 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:52:47.626438 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 req-ef81db9e-59d6-4357-8a31-149851b7ec2c tempest-VolumesAdminNegativeTest-1470267362 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.281s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:52:47.630231 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 req-ef81db9e-59d6-4357-8a31-149851b7ec2c tempest-VolumesAdminNegativeTest-1470267362 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-58bc667d-d54e-4146-bcf2-33215200e583', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '58bc667d-d54e-4146-bcf2-33215200e583', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:52:47.689139 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 req-ef81db9e-59d6-4357-8a31-149851b7ec2c tempest-VolumesAdminNegativeTest-1470267362 None] Connection info returned from driver {'name': 'volumes/volume-58bc667d-d54e-4146-bcf2-33215200e583', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '58bc667d-d54e-4146-bcf2-33215200e583', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a979663e-2f64-4c6d-8538-2a4e6417bf51'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:52:47.778857 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-d3408ce0-4dea-44ad-bfd5-a73d7188f4b4 req-ef81db9e-59d6-4357-8a31-149851b7ec2c tempest-VolumesAdminNegativeTest-1470267362 None] attachment_update completed successfully. Oct 22 20:52:52.699924 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-f68ef3ff-539f-484b-97ef-d31cdcd57092 req-06ad0bf6-e8cd-454c-8e23-9667fe37b120 tempest-VolumesAdminNegativeTest-1470267362 None] Terminate volume connection completed successfully. Oct 22 20:52:52.700526 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f68ef3ff-539f-484b-97ef-d31cdcd57092 req-06ad0bf6-e8cd-454c-8e23-9667fe37b120 tempest-VolumesAdminNegativeTest-1470267362 None] Deleting attachment a979663e-2f64-4c6d-8538-2a4e6417bf51. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 20:53:02.701350 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=45,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:04.568855 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=25,cinder:UPDATE=15,cinder:INSERT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:05.611702 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:53:05.641173 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Flow 'volume_create_manager' (5e89e3f0-4590-43cd-8607-6f6e574df405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:53:05.649237 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6612fe8a-6cf6-463a-8734-9641b75117f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:05.669276 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6612fe8a-6cf6-463a-8734-9641b75117f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-266360004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0b640f14-ba0f-4242-a080-e77941655d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11060bbcab6b45cabb1457319d72b982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T20:53:06Z,use_quota=True,user_id='93c41b7be1724632b0d6bd2bd3b57f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:05.676070 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c654e3f-cb67-4267-a2a6-c70ce712b14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:05.680957 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c654e3f-cb67-4267-a2a6-c70ce712b14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:05.687148 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251926e3-d094-43c5-84da-c200e6c998d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:05.693222 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251926e3-d094-43c5-84da-c200e6c998d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b640f14-ba0f-4242-a080-e77941655d79', 'volume_name': 'volume-0b640f14-ba0f-4242-a080-e77941655d79', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:05.698553 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c040755-ddbb-451d-9737-e5a5fd523f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:05.702668 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c040755-ddbb-451d-9737-e5a5fd523f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:05.710810 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2a5b00-1eee-43c1-bb46-62782f377c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:05.712244 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Volume 0b640f14-ba0f-4242-a080-e77941655d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b640f14-ba0f-4242-a080-e77941655d79', 'volume_size': 1} Oct 22 20:53:05.713109 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] creating volume 'volume-0b640f14-ba0f-4242-a080-e77941655d79' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 20:53:05.714998 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:05.796741 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:53:05.797136 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:53:05.801094 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2a5b00-1eee-43c1-bb46-62782f377c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b640f14-ba0f-4242-a080-e77941655d79', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:05.805902 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474b2e86-afce-4905-af84-06f8b8ea862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:05.817921 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Volume volume-0b640f14-ba0f-4242-a080-e77941655d79 (0b640f14-ba0f-4242-a080-e77941655d79): created successfully Oct 22 20:53:05.821702 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474b2e86-afce-4905-af84-06f8b8ea862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:05.827670 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Flow 'volume_create_manager' (5e89e3f0-4590-43cd-8607-6f6e574df405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:53:05.838868 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-54855d13-2e5a-4794-9ca9-d8f339592c3b tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Created volume successfully. Oct 22 20:53:08.019563 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-406d8ab5-bf5c-4190-a75a-3698c9af2692 req-73003eb2-f6b9-496c-8c30-e09813de8bbc tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:53:09.536472 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-406d8ab5-bf5c-4190-a75a-3698c9af2692 req-73003eb2-f6b9-496c-8c30-e09813de8bbc tempest-LiveAutoBlockMigrationV225Test-1332499062 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.517s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:53:09.538598 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-406d8ab5-bf5c-4190-a75a-3698c9af2692 req-73003eb2-f6b9-496c-8c30-e09813de8bbc tempest-LiveAutoBlockMigrationV225Test-1332499062 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0b640f14-ba0f-4242-a080-e77941655d79', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '0b640f14-ba0f-4242-a080-e77941655d79', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:53:09.598438 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-406d8ab5-bf5c-4190-a75a-3698c9af2692 req-73003eb2-f6b9-496c-8c30-e09813de8bbc tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Connection info returned from driver {'name': 'volumes/volume-0b640f14-ba0f-4242-a080-e77941655d79', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0b640f14-ba0f-4242-a080-e77941655d79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c9cea3e4-0d90-44cf-8f70-dbe0068b0e6a'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:53:09.730912 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-406d8ab5-bf5c-4190-a75a-3698c9af2692 req-73003eb2-f6b9-496c-8c30-e09813de8bbc tempest-LiveAutoBlockMigrationV225Test-1332499062 None] attachment_update completed successfully. Oct 22 20:53:14.465467 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:53:14.554400 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Flow 'volume_create_manager' (a13db75c-a726-48ef-9b6d-62405d058a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:53:14.599504 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0360c04-0bb1-4c0f-8e0b-cebd17920845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:14.674782 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0360c04-0bb1-4c0f-8e0b-cebd17920845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1859037214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48413ed1ac4e1ea65fb38f097881db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T20:53:14Z,use_quota=True,user_id='34f8af8ee2b545bead90fffd6c6c4896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:14.718965 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bd53f7-0c61-4ed0-8a5c-e4c27e16e358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:14.733556 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bd53f7-0c61-4ed0-8a5c-e4c27e16e358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:14.740789 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12202a7-a5c6-47fb-a3a6-c0bd74f6edda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:14.774585 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12202a7-a5c6-47fb-a3a6-c0bd74f6edda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b', 'volume_name': 'volume-2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:14.784917 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63920ec6-0b3e-4e99-971f-95e1255f0e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:14.788915 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63920ec6-0b3e-4e99-971f-95e1255f0e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:14.815424 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac71b19-a2a2-442a-b9aa-b31a8d386023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:14.816936 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Volume 2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b', 'volume_size': 1} Oct 22 20:53:14.817539 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] creating volume 'volume-2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 20:53:14.820962 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:15.010956 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:53:15.011973 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:53:15.016757 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac71b19-a2a2-442a-b9aa-b31a8d386023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:15.042952 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2787bd6-cf46-4ec2-850e-4c25bd4710b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:15.076282 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Volume volume-2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b (2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b): created successfully Oct 22 20:53:15.095128 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2787bd6-cf46-4ec2-850e-4c25bd4710b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:15.110411 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Flow 'volume_create_manager' (a13db75c-a726-48ef-9b6d-62405d058a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:53:15.137511 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-aab38f51-b75f-4202-ba46-1f239faba489 tempest-VolumesAdminNegativeTest-1470267362 None] Created volume successfully. Oct 22 20:53:15.814103 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] Acquiring lock "cinder-2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:53:15.839234 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] Lock "cinder-2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:53:15.958942 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:16.077424 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 20:53:16.078545 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] Volume volume-2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 20:53:16.088307 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] deleting rbd volume volume-2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 20:53:16.464499 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] Created reservations ['827c9cec-bdc1-4744-8def-0cde16213f86', '4ad42d27-d878-4e45-911b-fe0b4d370812', '61919437-ba00-4976-b7d8-3e41590eee73', 'd1b4738a-1d27-415b-9e34-0567c56f62fe'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 20:53:16.585190 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:16.666651 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:16.752972 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:53:16.757643 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] Deleted volume successfully. Oct 22 20:53:16.781278 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d0271e8c-b9cf-4759-ba76-c7549d6b82e6 tempest-VolumesAdminNegativeTest-1470267362 None] Lock "cinder-2d7c08ac-89f6-47cb-ae33-2f8975ff7c7b-delete_volume" released by "delete_volume" :: held 0.942s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:53:20.115977 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 req-e6dde761-d501-40a8-a315-38999727efa2 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:53:21.954806 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 req-e6dde761-d501-40a8-a315-38999727efa2 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.839s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:53:21.955756 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 req-e6dde761-d501-40a8-a315-38999727efa2 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0b640f14-ba0f-4242-a080-e77941655d79', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '0b640f14-ba0f-4242-a080-e77941655d79', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:53:21.987201 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 req-e6dde761-d501-40a8-a315-38999727efa2 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] Connection info returned from driver {'name': 'volumes/volume-0b640f14-ba0f-4242-a080-e77941655d79', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0b640f14-ba0f-4242-a080-e77941655d79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2f635d90-c4ff-431b-bf7a-4b4a6aaf9089'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:53:22.074371 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] Acquiring lock "cinder-58bc667d-d54e-4146-bcf2-33215200e583-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:53:22.107093 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 req-e6dde761-d501-40a8-a315-38999727efa2 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] attachment_update completed successfully. Oct 22 20:53:22.121589 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] Lock "cinder-58bc667d-d54e-4146-bcf2-33215200e583-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:53:22.216382 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:22.365902 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 20:53:22.366643 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] Volume volume-58bc667d-d54e-4146-bcf2-33215200e583 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 20:53:22.387126 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] deleting rbd volume volume-58bc667d-d54e-4146-bcf2-33215200e583 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 20:53:23.003003 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] Created reservations ['3dba5d18-e23f-4f42-ae5f-7f2e66e0de26', '1c82acff-f3c7-424b-8597-504e77275072', 'a612d85a-7326-4f94-8911-f5f3b1bad892', '8c0c5fb3-da14-4fd8-a563-4077ea0525f6'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 20:53:23.141155 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:23.233608 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:23.354954 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:53:23.362297 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] Deleted volume successfully. Oct 22 20:53:23.398557 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-811c03a3-f550-4615-9a07-5c8062d88a69 tempest-VolumesAdminNegativeTest-1470267362 None] Lock "cinder-58bc667d-d54e-4146-bcf2-33215200e583-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:53:30.451584 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:53:30.452266 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:30.561503 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:30.657497 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:53:34.626564 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=49,cinder:UPDATE=27,cinder:INSERT=4,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:34.628709 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=69,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:53:34.917596 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 req-a8d551a5-1b33-4a1a-b402-b9abb2ae542d tempest-LiveAutoBlockMigrationV225Test-1881980506 None] Terminate volume connection completed successfully. Oct 22 20:53:34.918013 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-b8ed320a-6485-43b5-b7bc-fe9450bb4446 req-a8d551a5-1b33-4a1a-b402-b9abb2ae542d tempest-LiveAutoBlockMigrationV225Test-1881980506 None] Deleting attachment c9cea3e4-0d90-44cf-8f70-dbe0068b0e6a. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 20:53:48.678871 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-e118aa8a-6990-4387-8082-32a39e71b219 req-1e0e164f-49a1-4833-8116-7265d3c23ea4 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Terminate volume connection completed successfully. Oct 22 20:53:48.679608 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-e118aa8a-6990-4387-8082-32a39e71b219 req-1e0e164f-49a1-4833-8116-7265d3c23ea4 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Deleting attachment 2f635d90-c4ff-431b-bf7a-4b4a6aaf9089. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 20:53:51.714022 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:53:51.802532 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Flow 'volume_create_manager' (ecdd3174-9da2-4af1-b289-5e3691705e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:53:51.828568 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8106d095-dc49-4f05-b54e-7af600c57231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:51.889469 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8106d095-dc49-4f05-b54e-7af600c57231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1496647235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d22119e1-5f3f-4632-9662-a540dcccb909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11060bbcab6b45cabb1457319d72b982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T20:53:52Z,use_quota=True,user_id='93c41b7be1724632b0d6bd2bd3b57f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:51.912048 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f29d1cc-9bba-4c86-b166-a9daef6905e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:51.917054 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f29d1cc-9bba-4c86-b166-a9daef6905e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:51.926104 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1997e636-5d3b-437b-b277-cbdc343bd161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:52.059126 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1997e636-5d3b-437b-b277-cbdc343bd161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd22119e1-5f3f-4632-9662-a540dcccb909', 'volume_name': 'volume-d22119e1-5f3f-4632-9662-a540dcccb909', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:52.095764 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af13eb5-0558-4179-8ff3-016811a24d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:52.105085 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af13eb5-0558-4179-8ff3-016811a24d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:52.128346 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8172ce7b-7872-4307-bdf6-6a8fc0c5edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:52.132787 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Volume d22119e1-5f3f-4632-9662-a540dcccb909: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d22119e1-5f3f-4632-9662-a540dcccb909', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 20:53:52.137437 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Cloning d22119e1-5f3f-4632-9662-a540dcccb909 from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 20:53:52.141026 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:53:52.172512 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.027s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:53:52.203427 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 20, 53, 52, 192686)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 20:53:52.205380 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 20:53:52.206013 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 20:53:52.223665 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.053s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:53:52.225511 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 20:53:52.238932 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 20, 53, 52, 235862)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 20:53:52.239848 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 20:53:52.240633 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 20:53:52.272109 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:52.411896 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] creating snapshot='volume-d22119e1-5f3f-4632-9662-a540dcccb909.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 20:53:53.006005 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-d22119e1-5f3f-4632-9662-a540dcccb909.clone_snap' to 'volume-d22119e1-5f3f-4632-9662-a540dcccb909' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 20:53:53.271405 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 20:53:53.272880 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:53:53.273465 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:53:53.306716 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 20:53:53.307375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Marking volume d22119e1-5f3f-4632-9662-a540dcccb909 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 20:53:53.321303 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to d22119e1-5f3f-4632-9662-a540dcccb909. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 20:53:53.321745 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Creating volume glance metadata for volume d22119e1-5f3f-4632-9662-a540dcccb909 backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 20:53:53.431002 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8172ce7b-7872-4307-bdf6-6a8fc0c5edab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22119e1-5f3f-4632-9662-a540dcccb909', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:53.452129 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56005211-e545-4128-9613-238e0d2f27e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:53.477287 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Volume volume-d22119e1-5f3f-4632-9662-a540dcccb909 (d22119e1-5f3f-4632-9662-a540dcccb909): created successfully Oct 22 20:53:53.482477 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56005211-e545-4128-9613-238e0d2f27e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:53.488420 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Flow 'volume_create_manager' (ecdd3174-9da2-4af1-b289-5e3691705e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:53:53.511391 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e3484f10-7e69-434e-9409-ff0f0f9df508 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Created volume successfully. Oct 22 20:53:57.453446 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:53:57.527260 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Flow 'volume_create_manager' (8a4b211c-7c9c-4b03-a159-6d89d893e8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:53:57.564738 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f29299-715a-43b3-a89e-a392967fe857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:57.664269 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f29299-715a-43b3-a89e-a392967fe857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1455930074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ea0d4b51-ed12-4296-878c-d315f57fb330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0ee8c8f7fc4e12bc1f9fcce3e7b581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T20:53:57Z,use_quota=True,user_id='2c87f0356ca346f39c6216393d85da2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:57.677196 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e3e194-afc5-4ea1-9ff5-2a391f7b7871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:57.689547 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e3e194-afc5-4ea1-9ff5-2a391f7b7871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:57.696874 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948fa632-b025-40b5-9532-68c43b70600a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:57.701492 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948fa632-b025-40b5-9532-68c43b70600a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0d4b51-ed12-4296-878c-d315f57fb330', 'volume_name': 'volume-ea0d4b51-ed12-4296-878c-d315f57fb330', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:57.706857 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8cd04a-f657-4dae-8365-7e9ea93a3eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:57.712201 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8cd04a-f657-4dae-8365-7e9ea93a3eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:57.743927 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fd2f7b-e7f1-46a9-98cd-a4e5fc521395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:57.745072 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Volume ea0d4b51-ed12-4296-878c-d315f57fb330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0d4b51-ed12-4296-878c-d315f57fb330', 'volume_size': 1} Oct 22 20:53:57.746065 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] creating volume 'volume-ea0d4b51-ed12-4296-878c-d315f57fb330' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 20:53:57.747327 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:53:57.798501 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-e5732161-8d96-4a11-8baa-e58b6315f7af req-1b1639f4-82b1-48ab-a675-5606e743bc2a tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:53:57.879980 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:53:57.880771 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:53:57.887911 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fd2f7b-e7f1-46a9-98cd-a4e5fc521395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0d4b51-ed12-4296-878c-d315f57fb330', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:57.901442 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cf0b10-0484-4fda-a6d6-a6953aae6e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:53:57.947825 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Volume volume-ea0d4b51-ed12-4296-878c-d315f57fb330 (ea0d4b51-ed12-4296-878c-d315f57fb330): created successfully Oct 22 20:53:57.951979 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cf0b10-0484-4fda-a6d6-a6953aae6e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:53:57.969449 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Flow 'volume_create_manager' (8a4b211c-7c9c-4b03-a159-6d89d893e8bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:53:57.995655 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-3e9f869b-d240-426f-a093-4af8b3d608dc tempest-LiveMigrationTest-26615209 None] Created volume successfully. Oct 22 20:53:59.135899 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-e5732161-8d96-4a11-8baa-e58b6315f7af req-1b1639f4-82b1-48ab-a675-5606e743bc2a tempest-LiveAutoBlockMigrationV225Test-1332499062 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.337s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:53:59.136792 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-e5732161-8d96-4a11-8baa-e58b6315f7af req-1b1639f4-82b1-48ab-a675-5606e743bc2a tempest-LiveAutoBlockMigrationV225Test-1332499062 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d22119e1-5f3f-4632-9662-a540dcccb909', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'd22119e1-5f3f-4632-9662-a540dcccb909', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:53:59.197448 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-e5732161-8d96-4a11-8baa-e58b6315f7af req-1b1639f4-82b1-48ab-a675-5606e743bc2a tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Connection info returned from driver {'name': 'volumes/volume-d22119e1-5f3f-4632-9662-a540dcccb909', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd22119e1-5f3f-4632-9662-a540dcccb909', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '908e3b7c-1283-4356-a3ce-489836753148'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:53:59.333357 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-e5732161-8d96-4a11-8baa-e58b6315f7af req-1b1639f4-82b1-48ab-a675-5606e743bc2a tempest-LiveAutoBlockMigrationV225Test-1332499062 None] attachment_update completed successfully. Oct 22 20:53:59.547379 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 req-911469c0-34c9-4607-b911-7fedcd923479 tempest-LiveMigrationTest-26615209 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:54:01.675158 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 req-911469c0-34c9-4607-b911-7fedcd923479 tempest-LiveMigrationTest-26615209 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.127s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:54:01.676020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 req-911469c0-34c9-4607-b911-7fedcd923479 tempest-LiveMigrationTest-26615209 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ea0d4b51-ed12-4296-878c-d315f57fb330', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'ea0d4b51-ed12-4296-878c-d315f57fb330', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:54:01.741639 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 req-911469c0-34c9-4607-b911-7fedcd923479 tempest-LiveMigrationTest-26615209 None] Connection info returned from driver {'name': 'volumes/volume-ea0d4b51-ed12-4296-878c-d315f57fb330', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ea0d4b51-ed12-4296-878c-d315f57fb330', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c393e5cc-946d-4c45-89b7-3bd94bc767ac'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:54:01.890402 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-bf87c45c-d2ba-4a71-a940-7bbf36ae7970 req-911469c0-34c9-4607-b911-7fedcd923479 tempest-LiveMigrationTest-26615209 None] attachment_update completed successfully. Oct 22 20:54:14.235290 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=48,cinder:UPDATE=13,cinder:INSERT=6,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:14.236443 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=53,cinder:UPDATE=6,cinder:INSERT=6,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:14.260043 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-6c47dd2b-41ec-4f93-a74f-856dda6583df req-7463c749-948c-4d31-99cd-56aacf862bf1 tempest-LiveMigrationTest-1665192420 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:54:15.840500 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-6c47dd2b-41ec-4f93-a74f-856dda6583df req-7463c749-948c-4d31-99cd-56aacf862bf1 tempest-LiveMigrationTest-1665192420 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.580s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:54:15.842739 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-6c47dd2b-41ec-4f93-a74f-856dda6583df req-7463c749-948c-4d31-99cd-56aacf862bf1 tempest-LiveMigrationTest-1665192420 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ea0d4b51-ed12-4296-878c-d315f57fb330', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'ea0d4b51-ed12-4296-878c-d315f57fb330', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:54:15.918396 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-6c47dd2b-41ec-4f93-a74f-856dda6583df req-7463c749-948c-4d31-99cd-56aacf862bf1 tempest-LiveMigrationTest-1665192420 None] Connection info returned from driver {'name': 'volumes/volume-ea0d4b51-ed12-4296-878c-d315f57fb330', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ea0d4b51-ed12-4296-878c-d315f57fb330', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9785c0d7-d028-4cf3-b4b0-1f089cce0991'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:54:16.041765 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-6c47dd2b-41ec-4f93-a74f-856dda6583df req-7463c749-948c-4d31-99cd-56aacf862bf1 tempest-LiveMigrationTest-1665192420 None] attachment_update completed successfully. Oct 22 20:54:26.030844 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:28.308201 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-6c47dd2b-41ec-4f93-a74f-856dda6583df req-63418103-afff-43bd-bd90-87123b2e0aa0 tempest-LiveMigrationTest-1665192420 None] Terminate volume connection completed successfully. Oct 22 20:54:28.308909 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-6c47dd2b-41ec-4f93-a74f-856dda6583df req-63418103-afff-43bd-bd90-87123b2e0aa0 tempest-LiveMigrationTest-1665192420 None] Deleting attachment c393e5cc-946d-4c45-89b7-3bd94bc767ac. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 20:54:30.453089 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:54:30.454024 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:54:30.558821 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:54:30.697241 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:54:38.307634 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:42.914435 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-f690e6f6-cfd1-4449-89db-027957237947 req-9226257b-3a18-46d6-a40a-1894b50c9ed7 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:54:44.147474 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-1f560a00-4b68-40b3-b267-b238fb0adbf9 req-66f1e9ed-b3f0-4a8e-ae7e-c10cc0f60a25 tempest-LiveMigrationTest-26615209 None] Terminate volume connection completed successfully. Oct 22 20:54:44.150341 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-1f560a00-4b68-40b3-b267-b238fb0adbf9 req-66f1e9ed-b3f0-4a8e-ae7e-c10cc0f60a25 tempest-LiveMigrationTest-26615209 None] Deleting attachment 9785c0d7-d028-4cf3-b4b0-1f089cce0991. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 20:54:44.159637 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-f690e6f6-cfd1-4449-89db-027957237947 req-9226257b-3a18-46d6-a40a-1894b50c9ed7 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.245s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:54:44.161571 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-f690e6f6-cfd1-4449-89db-027957237947 req-9226257b-3a18-46d6-a40a-1894b50c9ed7 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d22119e1-5f3f-4632-9662-a540dcccb909', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'd22119e1-5f3f-4632-9662-a540dcccb909', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:54:44.256549 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f690e6f6-cfd1-4449-89db-027957237947 req-9226257b-3a18-46d6-a40a-1894b50c9ed7 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] Connection info returned from driver {'name': 'volumes/volume-d22119e1-5f3f-4632-9662-a540dcccb909', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd22119e1-5f3f-4632-9662-a540dcccb909', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e5852060-3a0b-4dd7-83f8-d670aa3605ec'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:54:44.357537 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=27,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:54:44.432761 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-f690e6f6-cfd1-4449-89db-027957237947 req-9226257b-3a18-46d6-a40a-1894b50c9ed7 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] attachment_update completed successfully. Oct 22 20:54:46.378377 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:54:46.410334 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Flow 'volume_create_manager' (a289d96c-bbe2-459c-9ab7-91f2583f4a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:54:46.418406 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37cafe4-b7c3-42ad-a063-6601df755041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:54:46.449922 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37cafe4-b7c3-42ad-a063-6601df755041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-819804012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e0d87279-2183-4c20-872e-8170476b3f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0ee8c8f7fc4e12bc1f9fcce3e7b581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T20:54:46Z,use_quota=True,user_id='2c87f0356ca346f39c6216393d85da2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:54:46.457355 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cde371-9508-4150-b762-5d5f4d96b6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:54:46.463505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cde371-9508-4150-b762-5d5f4d96b6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:54:46.471914 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05330e8e-cd88-4edc-bfe6-63e08b43c0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:54:46.609554 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05330e8e-cd88-4edc-bfe6-63e08b43c0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0d87279-2183-4c20-872e-8170476b3f01', 'volume_name': 'volume-e0d87279-2183-4c20-872e-8170476b3f01', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:54:46.616959 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a3aac3-8a3b-42ee-b67c-4801809beda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:54:46.622419 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a3aac3-8a3b-42ee-b67c-4801809beda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:54:46.628219 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c3a958-abb1-442d-8eba-b6d96acb6141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:54:46.630751 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Volume e0d87279-2183-4c20-872e-8170476b3f01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0d87279-2183-4c20-872e-8170476b3f01', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 20:54:46.631879 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Cloning e0d87279-2183-4c20-872e-8170476b3f01 from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 20:54:46.634183 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:54:46.646086 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:54:46.662949 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 20, 54, 46, 650734)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 20:54:46.663780 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 20:54:46.664269 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 20:54:46.669664 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:54:46.670669 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 20:54:46.680225 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 20, 54, 46, 676931)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 20:54:46.681520 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 20:54:46.682073 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 20:54:46.698893 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:54:46.825706 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] creating snapshot='volume-e0d87279-2183-4c20-872e-8170476b3f01.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 20:54:47.598980 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-e0d87279-2183-4c20-872e-8170476b3f01.clone_snap' to 'volume-e0d87279-2183-4c20-872e-8170476b3f01' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 20:54:47.840733 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 20:54:47.841919 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:54:47.843003 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:54:47.886102 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 20:54:47.887141 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Marking volume e0d87279-2183-4c20-872e-8170476b3f01 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 20:54:47.906729 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to e0d87279-2183-4c20-872e-8170476b3f01. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 20:54:47.909046 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Creating volume glance metadata for volume e0d87279-2183-4c20-872e-8170476b3f01 backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 20:54:48.011648 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c3a958-abb1-442d-8eba-b6d96acb6141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0d87279-2183-4c20-872e-8170476b3f01', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:54:48.016616 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77998bd-a948-401a-af59-43c8e680550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:54:48.039540 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Volume volume-e0d87279-2183-4c20-872e-8170476b3f01 (e0d87279-2183-4c20-872e-8170476b3f01): created successfully Oct 22 20:54:48.048642 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77998bd-a948-401a-af59-43c8e680550e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:54:48.055438 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Flow 'volume_create_manager' (a289d96c-bbe2-459c-9ab7-91f2583f4a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:54:48.067056 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-3397db21-9cc8-44fe-9d16-31c7e4867f76 tempest-LiveMigrationTest-26615209 None] Created volume successfully. Oct 22 20:54:52.596886 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-f690e6f6-cfd1-4449-89db-027957237947 req-6754f567-b2c0-44ea-8c7a-02d9eb0e6da6 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] Terminate volume connection completed successfully. Oct 22 20:54:52.598094 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f690e6f6-cfd1-4449-89db-027957237947 req-6754f567-b2c0-44ea-8c7a-02d9eb0e6da6 tempest-LiveAutoBlockMigrationV225Test-1881980506 None] Deleting attachment 908e3b7c-1283-4356-a3ce-489836753148. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 20:54:54.553752 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de req-c8d27182-e1ef-4b83-905d-198093a61053 tempest-LiveMigrationTest-26615209 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:54:56.200662 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de req-c8d27182-e1ef-4b83-905d-198093a61053 tempest-LiveMigrationTest-26615209 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.647s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:54:56.202108 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de req-c8d27182-e1ef-4b83-905d-198093a61053 tempest-LiveMigrationTest-26615209 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e0d87279-2183-4c20-872e-8170476b3f01', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'e0d87279-2183-4c20-872e-8170476b3f01', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:54:56.243316 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de req-c8d27182-e1ef-4b83-905d-198093a61053 tempest-LiveMigrationTest-26615209 None] Connection info returned from driver {'name': 'volumes/volume-e0d87279-2183-4c20-872e-8170476b3f01', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e0d87279-2183-4c20-872e-8170476b3f01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a816f547-24cf-488b-bd3e-f06f06b9d6dd'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:54:56.366134 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-e1c2fae7-28ce-4ffb-885d-4ff4988e51de req-c8d27182-e1ef-4b83-905d-198093a61053 tempest-LiveMigrationTest-26615209 None] attachment_update completed successfully. Oct 22 20:55:13.020213 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=46,cinder:UPDATE=9,cinder:INSERT=5,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:13.021843 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-fc584aad-e468-4351-b627-3427c0627150 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Terminate volume connection completed successfully. Oct 22 20:55:13.022259 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-fc584aad-e468-4351-b627-3427c0627150 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Deleting attachment e5852060-3a0b-4dd7-83f8-d670aa3605ec. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 20:55:13.520809 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Acquiring lock "cinder-d22119e1-5f3f-4632-9662-a540dcccb909-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:55:13.537616 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Lock "cinder-d22119e1-5f3f-4632-9662-a540dcccb909-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:55:13.654922 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:55:13.806099 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 20:55:13.821261 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] deleting rbd volume volume-d22119e1-5f3f-4632-9662-a540dcccb909 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 20:55:14.266742 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 20:55:14.301837 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] deleting parent snapshot volume-d22119e1-5f3f-4632-9662-a540dcccb909.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 20:55:15.100849 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Acquiring lock "cinder-0b640f14-ba0f-4242-a080-e77941655d79-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:55:15.145506 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=45,cinder:UPDATE=6,cinder:INSERT=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:15.157231 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Lock "cinder-0b640f14-ba0f-4242-a080-e77941655d79-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:55:15.257727 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:55:15.326954 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 20:55:15.328223 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Volume volume-0b640f14-ba0f-4242-a080-e77941655d79 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 20:55:15.338440 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] deleting rbd volume volume-0b640f14-ba0f-4242-a080-e77941655d79 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 20:55:15.341546 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Created reservations ['cb255446-5a93-4d79-b76e-62c9246de48d', 'dca26862-58d6-4334-bebe-6f8b15757527', 'c821db55-9397-4ae9-a62b-05c250a69c19', 'acdb4e26-4281-403e-af9f-eb3e3f571b71'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 20:55:15.423947 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:55:15.488798 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:55:15.562018 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:55:15.566878 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Deleted volume successfully. Oct 22 20:55:15.593504 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-bbd3ee9b-a0e7-4be6-9812-bfc46246c7ef req-ced25128-ab5f-406e-9f58-2bfb9f3f9f79 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Lock "cinder-d22119e1-5f3f-4632-9662-a540dcccb909-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:55:15.751375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Created reservations ['df98ea5f-3057-42c9-b482-a5c7e08214d0', 'fa922408-0357-4c93-a9e1-1540d8ad83f7', 'd233f578-1a01-49b0-8ba2-e71bfaff932d', 'e478057d-ab03-43e2-94d4-9e52d59055db'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 20:55:15.820881 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:55:15.910250 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:55:15.972410 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:55:15.980943 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Deleted volume successfully. Oct 22 20:55:16.002997 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a0b89153-c76d-49dc-9332-a334e33bbcc0 tempest-LiveAutoBlockMigrationV225Test-1332499062 None] Lock "cinder-0b640f14-ba0f-4242-a080-e77941655d79-delete_volume" released by "delete_volume" :: held 0.847s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:55:25.986238 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=34,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:28.139045 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-efface9f-ee4c-4706-ab59-ee2188bd894f req-337b71a8-297c-40c8-ba7d-7f32b2e41fbb tempest-LiveMigrationTest-1665192420 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:55:29.965805 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-efface9f-ee4c-4706-ab59-ee2188bd894f req-337b71a8-297c-40c8-ba7d-7f32b2e41fbb tempest-LiveMigrationTest-1665192420 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.828s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:55:29.967247 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-efface9f-ee4c-4706-ab59-ee2188bd894f req-337b71a8-297c-40c8-ba7d-7f32b2e41fbb tempest-LiveMigrationTest-1665192420 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e0d87279-2183-4c20-872e-8170476b3f01', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'e0d87279-2183-4c20-872e-8170476b3f01', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:55:30.030352 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-efface9f-ee4c-4706-ab59-ee2188bd894f req-337b71a8-297c-40c8-ba7d-7f32b2e41fbb tempest-LiveMigrationTest-1665192420 None] Connection info returned from driver {'name': 'volumes/volume-e0d87279-2183-4c20-872e-8170476b3f01', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e0d87279-2183-4c20-872e-8170476b3f01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '59bc0314-cba5-4162-b87f-29dece390c62'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:55:30.220939 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-efface9f-ee4c-4706-ab59-ee2188bd894f req-337b71a8-297c-40c8-ba7d-7f32b2e41fbb tempest-LiveMigrationTest-1665192420 None] attachment_update completed successfully. Oct 22 20:55:30.452961 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:55:30.454219 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:55:30.565104 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:55:30.691660 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:55:41.922210 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-efface9f-ee4c-4706-ab59-ee2188bd894f req-429dadd9-1e99-4d95-9530-2230843a45f1 tempest-LiveMigrationTest-1665192420 None] Terminate volume connection completed successfully. Oct 22 20:55:41.929661 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-efface9f-ee4c-4706-ab59-ee2188bd894f req-429dadd9-1e99-4d95-9530-2230843a45f1 tempest-LiveMigrationTest-1665192420 None] Deleting attachment a816f547-24cf-488b-bd3e-f06f06b9d6dd. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 20:55:55.110085 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=32,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:55:55.114940 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=17,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:01.296580 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-425ba58c-18be-4e32-bbcd-18c0d35c9c15 tempest-LiveMigrationTest-26615209 None] Terminate volume connection completed successfully. Oct 22 20:56:01.297260 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-425ba58c-18be-4e32-bbcd-18c0d35c9c15 tempest-LiveMigrationTest-26615209 None] Deleting attachment 59bc0314-cba5-4162-b87f-29dece390c62. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 20:56:01.478868 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] Acquiring lock "cinder-e0d87279-2183-4c20-872e-8170476b3f01-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:56:01.492621 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] Lock "cinder-e0d87279-2183-4c20-872e-8170476b3f01-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:56:01.578600 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:56:01.731124 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 20:56:01.746636 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] deleting rbd volume volume-e0d87279-2183-4c20-872e-8170476b3f01 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 20:56:02.059680 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 20:56:02.109262 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] deleting parent snapshot volume-e0d87279-2183-4c20-872e-8170476b3f01.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 20:56:03.078345 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] Created reservations ['1f05eb6d-06c5-4767-b668-3439ee475138', '954f8668-beae-495f-8a69-fcc5d7da6d2c', 'e64cad6c-851b-4f52-a5ce-0f1b963f96c8', 'ebbcdaca-9375-4e11-9b82-a65af4c0ab14'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 20:56:03.133144 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:56:03.180545 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:56:03.220776 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:56:03.232784 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] Deleted volume successfully. Oct 22 20:56:03.249768 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-457feaef-f847-4b3f-bd10-e570d051d3ab req-c22bc4e1-0e90-47d3-bc7e-b32d228e7bc5 tempest-LiveMigrationTest-26615209 None] Lock "cinder-e0d87279-2183-4c20-872e-8170476b3f01-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:56:04.410210 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] Acquiring lock "cinder-ea0d4b51-ed12-4296-878c-d315f57fb330-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:56:04.434274 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] Lock "cinder-ea0d4b51-ed12-4296-878c-d315f57fb330-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:56:04.545394 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:56:04.688055 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 20:56:04.688745 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] Volume volume-ea0d4b51-ed12-4296-878c-d315f57fb330 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 20:56:04.710351 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] deleting rbd volume volume-ea0d4b51-ed12-4296-878c-d315f57fb330 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 20:56:05.250510 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] Created reservations ['b1127db5-03fb-4499-8f07-973d288850fe', 'dd97de31-2380-498b-8762-2c8d21e83aa4', '05d4bdcc-3995-4dd0-8812-dfbe14a15ca3', 'a256d23b-12ab-4666-9982-443cc3acbaa6'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 20:56:05.353252 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:56:05.441758 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:56:05.501700 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:56:05.507162 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] Deleted volume successfully. Oct 22 20:56:05.526231 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-1014fecd-ffc9-4c08-a9e6-a8cae16032b2 tempest-LiveMigrationTest-26615209 None] Lock "cinder-ea0d4b51-ed12-4296-878c-d315f57fb330-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:56:15.513328 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=31,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:30.458502 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:56:30.458502 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:56:30.543833 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:56:30.660017 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:56:35.099317 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=33,cinder:UPDATE=17,cinder:INSERT=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:55.104915 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:05.106907 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:25.105909 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:57:30.455023 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:57:30.456404 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:57:30.513341 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:57:30.584712 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:57:35.086711 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:05.090230 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:15.102718 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:30.460294 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:58:30.461703 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:58:30.516383 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:58:30.572229 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:58:45.088406 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:58:50.070926 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:58:50.126948 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Flow 'volume_create_manager' (deaa77d5-b76f-45f2-bc81-3d0f102fafa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:58:50.140479 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d01dd2-c003-4449-a8fb-b03a18037863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:50.188442 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d01dd2-c003-4449-a8fb-b03a18037863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1318354801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d1d5f32b-f8b3-4714-96ae-203dc0482f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd687d54e07d4ab4af00ad801ef4b58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T20:58:50Z,use_quota=True,user_id='211483c6acea4f76b6c0e4bfc818e7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:50.193820 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5642ee-7b7f-43ce-97b3-5f7b52b977b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:50.198832 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5642ee-7b7f-43ce-97b3-5f7b52b977b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:50.204804 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1aa04c5-29b5-4ede-82c7-9207cc8af35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:50.317586 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1aa04c5-29b5-4ede-82c7-9207cc8af35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1d5f32b-f8b3-4714-96ae-203dc0482f4b', 'volume_name': 'volume-d1d5f32b-f8b3-4714-96ae-203dc0482f4b', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:50.322932 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc6628b-46b6-41ce-a233-5636f42c388f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:50.327817 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc6628b-46b6-41ce-a233-5636f42c388f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:50.333363 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762d3e0c-859c-4d31-b2fe-7f765fa63670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:50.334978 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume d1d5f32b-f8b3-4714-96ae-203dc0482f4b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1d5f32b-f8b3-4714-96ae-203dc0482f4b', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 20:58:50.336130 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Cloning d1d5f32b-f8b3-4714-96ae-203dc0482f4b from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 20:58:50.338314 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 20:58:50.349234 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 20:58:50.363595 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 20, 58, 50, 354979)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 20:58:50.365211 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 20:58:50.365946 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 20:58:50.374154 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 20:58:50.375718 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 20:58:50.383553 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 20, 58, 50, 380049)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 20:58:50.384321 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 20:58:50.384938 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 20:58:50.398839 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:58:50.489234 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] creating snapshot='volume-d1d5f32b-f8b3-4714-96ae-203dc0482f4b.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 20:58:51.409842 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-d1d5f32b-f8b3-4714-96ae-203dc0482f4b.clone_snap' to 'volume-d1d5f32b-f8b3-4714-96ae-203dc0482f4b' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 20:58:51.610352 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 20:58:51.611588 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:58:51.611970 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:58:51.648483 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 20:58:51.649480 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Marking volume d1d5f32b-f8b3-4714-96ae-203dc0482f4b as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 20:58:51.663082 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to d1d5f32b-f8b3-4714-96ae-203dc0482f4b. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 20:58:51.663744 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Creating volume glance metadata for volume d1d5f32b-f8b3-4714-96ae-203dc0482f4b backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 20:58:51.900944 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762d3e0c-859c-4d31-b2fe-7f765fa63670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d5f32b-f8b3-4714-96ae-203dc0482f4b', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:51.907073 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0243722b-8a30-4736-8286-3e3761bf5782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:51.938438 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume volume-d1d5f32b-f8b3-4714-96ae-203dc0482f4b (d1d5f32b-f8b3-4714-96ae-203dc0482f4b): created successfully Oct 22 20:58:51.946192 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0243722b-8a30-4736-8286-3e3761bf5782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:51.959516 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Flow 'volume_create_manager' (deaa77d5-b76f-45f2-bc81-3d0f102fafa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:58:51.987604 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-3ee2df24-edd3-469e-8940-5af14b21f00b tempest-TaggedBootDevicesTest_v242-1175888917 None] Created volume successfully. Oct 22 20:58:53.055653 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:58:53.112132 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Flow 'volume_create_manager' (589a1843-2026-4828-9d09-86592c45dcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:58:53.131194 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070bae02-a14b-4d20-b266-aea4be2560c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:53.164946 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070bae02-a14b-4d20-b266-aea4be2560c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1114577970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b9bd5cf-91ea-49ac-9156-2270dc908725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd687d54e07d4ab4af00ad801ef4b58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T20:58:53Z,use_quota=True,user_id='211483c6acea4f76b6c0e4bfc818e7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:53.187637 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77c0e21-8b4e-4376-a934-f7f5458167e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:53.200540 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77c0e21-8b4e-4376-a934-f7f5458167e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:53.206802 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce95398b-f59f-4237-8176-e198ad67781f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:53.218975 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce95398b-f59f-4237-8176-e198ad67781f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9bd5cf-91ea-49ac-9156-2270dc908725', 'volume_name': 'volume-1b9bd5cf-91ea-49ac-9156-2270dc908725', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:53.232332 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18821dfc-4361-4077-8358-3e60a033fc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:53.239716 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18821dfc-4361-4077-8358-3e60a033fc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:53.263125 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80af8f9f-fa77-482c-9dd8-d83bc7145422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:53.264946 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume 1b9bd5cf-91ea-49ac-9156-2270dc908725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9bd5cf-91ea-49ac-9156-2270dc908725', 'volume_size': 1} Oct 22 20:58:53.267831 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] creating volume 'volume-1b9bd5cf-91ea-49ac-9156-2270dc908725' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 20:58:53.268885 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:58:53.418713 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:58:53.419288 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:58:53.426761 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80af8f9f-fa77-482c-9dd8-d83bc7145422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9bd5cf-91ea-49ac-9156-2270dc908725', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:53.436118 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806751dc-45ba-4cc7-b69e-bdba7e02c355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:53.465549 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume volume-1b9bd5cf-91ea-49ac-9156-2270dc908725 (1b9bd5cf-91ea-49ac-9156-2270dc908725): created successfully Oct 22 20:58:53.470506 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806751dc-45ba-4cc7-b69e-bdba7e02c355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:53.489437 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Flow 'volume_create_manager' (589a1843-2026-4828-9d09-86592c45dcb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:58:53.517810 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2c45f3ef-2290-4de7-8db9-ac2a3e487469 tempest-TaggedBootDevicesTest_v242-1175888917 None] Created volume successfully. Oct 22 20:58:54.718311 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 20:58:54.742533 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Flow 'volume_create_manager' (bc5d9775-14e0-46d8-9cab-d0a87f344e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:58:54.749268 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba0fc9f-c158-465d-9a15-ff3db070c850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:54.771768 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba0fc9f-c158-465d-9a15-ff3db070c850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T20:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1098828922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ebb1b567-e10c-480f-8fc1-0b24f1086d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd687d54e07d4ab4af00ad801ef4b58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T20:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T20:58:55Z,use_quota=True,user_id='211483c6acea4f76b6c0e4bfc818e7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:54.779787 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3e2991-914d-4562-bfec-a8e923ad0271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:54.785884 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3e2991-914d-4562-bfec-a8e923ad0271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:54.793007 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e89443-49c0-4bdc-8dd3-424742dc857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:54.803605 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e89443-49c0-4bdc-8dd3-424742dc857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb1b567-e10c-480f-8fc1-0b24f1086d7e', 'volume_name': 'volume-ebb1b567-e10c-480f-8fc1-0b24f1086d7e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:54.809931 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f079774-b211-45db-a180-50461ed7d956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:54.819322 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f079774-b211-45db-a180-50461ed7d956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:54.827267 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00e9274-aa7a-46cb-9100-3707f28fd7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:54.829103 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume ebb1b567-e10c-480f-8fc1-0b24f1086d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb1b567-e10c-480f-8fc1-0b24f1086d7e', 'volume_size': 1} Oct 22 20:58:54.829975 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] creating volume 'volume-ebb1b567-e10c-480f-8fc1-0b24f1086d7e' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 20:58:54.831770 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:58:54.958934 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 20:58:54.961167 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 20:58:54.969128 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00e9274-aa7a-46cb-9100-3707f28fd7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb1b567-e10c-480f-8fc1-0b24f1086d7e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:54.985719 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912da264-6cc9-4d1c-85fb-94783996932d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 20:58:55.012437 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume volume-ebb1b567-e10c-480f-8fc1-0b24f1086d7e (ebb1b567-e10c-480f-8fc1-0b24f1086d7e): created successfully Oct 22 20:58:55.025433 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912da264-6cc9-4d1c-85fb-94783996932d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 20:58:55.052129 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Flow 'volume_create_manager' (bc5d9775-14e0-46d8-9cab-d0a87f344e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 20:58:55.079683 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-bda07d00-384c-47d7-a532-16204fccbe4c tempest-TaggedBootDevicesTest_v242-1175888917 None] Created volume successfully. Oct 22 20:59:05.092515 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=26,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:15.099541 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=30,cinder:UPDATE=10,cinder:INSERT=12,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:25.358241 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-61febfe2-29b6-4105-a2d0-e7d3c0114b8a tempest-TaggedBootDevicesTest_v242-1175888917 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:59:26.693492 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-61febfe2-29b6-4105-a2d0-e7d3c0114b8a tempest-TaggedBootDevicesTest_v242-1175888917 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.335s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:59:26.697086 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-61febfe2-29b6-4105-a2d0-e7d3c0114b8a tempest-TaggedBootDevicesTest_v242-1175888917 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d1d5f32b-f8b3-4714-96ae-203dc0482f4b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'd1d5f32b-f8b3-4714-96ae-203dc0482f4b', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:59:26.747592 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-61febfe2-29b6-4105-a2d0-e7d3c0114b8a tempest-TaggedBootDevicesTest_v242-1175888917 None] Connection info returned from driver {'name': 'volumes/volume-d1d5f32b-f8b3-4714-96ae-203dc0482f4b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd1d5f32b-f8b3-4714-96ae-203dc0482f4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3ffc2079-00e7-435a-a1ad-ec49f69df002'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:59:26.830352 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-61febfe2-29b6-4105-a2d0-e7d3c0114b8a tempest-TaggedBootDevicesTest_v242-1175888917 None] attachment_update completed successfully. Oct 22 20:59:29.005085 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-0353aa8a-1846-448e-8a32-feb8550eeff2 tempest-TaggedBootDevicesTest_v242-1175888917 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:59:30.093931 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-0353aa8a-1846-448e-8a32-feb8550eeff2 tempest-TaggedBootDevicesTest_v242-1175888917 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.088s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:59:30.095565 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-0353aa8a-1846-448e-8a32-feb8550eeff2 tempest-TaggedBootDevicesTest_v242-1175888917 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1b9bd5cf-91ea-49ac-9156-2270dc908725', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '1b9bd5cf-91ea-49ac-9156-2270dc908725', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:59:30.127070 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-0353aa8a-1846-448e-8a32-feb8550eeff2 tempest-TaggedBootDevicesTest_v242-1175888917 None] Connection info returned from driver {'name': 'volumes/volume-1b9bd5cf-91ea-49ac-9156-2270dc908725', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1b9bd5cf-91ea-49ac-9156-2270dc908725', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a32d070d-e8b7-4e77-809c-49b60a67efdf'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:59:30.238975 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-0353aa8a-1846-448e-8a32-feb8550eeff2 tempest-TaggedBootDevicesTest_v242-1175888917 None] attachment_update completed successfully. Oct 22 20:59:30.456810 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 20:59:30.458021 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:59:30.524074 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 20:59:30.596176 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 20:59:30.632454 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-d705f407-7108-4c42-b65f-d26b60973a9c tempest-TaggedBootDevicesTest_v242-1175888917 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 20:59:31.863282 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-d705f407-7108-4c42-b65f-d26b60973a9c tempest-TaggedBootDevicesTest_v242-1175888917 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.231s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 20:59:31.865138 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-d705f407-7108-4c42-b65f-d26b60973a9c tempest-TaggedBootDevicesTest_v242-1175888917 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ebb1b567-e10c-480f-8fc1-0b24f1086d7e', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'ebb1b567-e10c-480f-8fc1-0b24f1086d7e', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 20:59:31.919593 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-d705f407-7108-4c42-b65f-d26b60973a9c tempest-TaggedBootDevicesTest_v242-1175888917 None] Connection info returned from driver {'name': 'volumes/volume-ebb1b567-e10c-480f-8fc1-0b24f1086d7e', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ebb1b567-e10c-480f-8fc1-0b24f1086d7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '315d9685-2ecc-4017-aeda-f529f4735d73'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 20:59:32.027471 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-ee73844c-763d-48fa-bd35-6c4ca1131e21 req-d705f407-7108-4c42-b65f-d26b60973a9c tempest-TaggedBootDevicesTest_v242-1175888917 None] attachment_update completed successfully. Oct 22 20:59:45.093457 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=38,cinder:UPDATE=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:59:55.098316 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=38,cinder:UPDATE=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:05.115605 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:25.093667 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:30.458050 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:00:30.459103 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:00:30.540812 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:00:30.590706 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:00:35.096251 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:00:55.106186 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:05.122432 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:12.904732 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:01:12.960548 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Flow 'volume_create_manager' (6bfde16e-1931-4ca8-8dc4-54f7867b9117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:01:12.967059 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357804e4-66e0-436e-ad36-41390c1e0e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:01:13.001452 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357804e4-66e0-436e-ad36-41390c1e0e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1605735745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d2013d8-0420-4b76-9785-fd5fa05ccf6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd7873d6db4e09bc9ab9a048a6b1ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:01:13Z,use_quota=True,user_id='be1b410a64e0415a96d30f5040361137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:01:13.022542 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db123e92-f856-4791-99bd-d7e2cf8fa19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:01:13.031867 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db123e92-f856-4791-99bd-d7e2cf8fa19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:01:13.043377 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17639554-2594-4fd6-96ae-7575e105c980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:01:13.059163 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17639554-2594-4fd6-96ae-7575e105c980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d2013d8-0420-4b76-9785-fd5fa05ccf6e', 'volume_name': 'volume-5d2013d8-0420-4b76-9785-fd5fa05ccf6e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:01:13.075644 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2c8556-7d2c-4ea0-9a09-24fbbbd38f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:01:13.082309 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2c8556-7d2c-4ea0-9a09-24fbbbd38f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:01:13.094960 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14d439c-8948-4303-9cb3-ea5dfedbf8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:01:13.099936 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Volume 5d2013d8-0420-4b76-9785-fd5fa05ccf6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d2013d8-0420-4b76-9785-fd5fa05ccf6e', 'volume_size': 1} Oct 22 21:01:13.101606 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] creating volume 'volume-5d2013d8-0420-4b76-9785-fd5fa05ccf6e' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:01:13.103018 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:01:13.268463 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:01:13.268848 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:01:13.275759 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14d439c-8948-4303-9cb3-ea5dfedbf8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2013d8-0420-4b76-9785-fd5fa05ccf6e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:01:13.291997 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a810cf-b69c-4c65-987b-53df06da3614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:01:13.321250 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Volume volume-5d2013d8-0420-4b76-9785-fd5fa05ccf6e (5d2013d8-0420-4b76-9785-fd5fa05ccf6e): created successfully Oct 22 21:01:13.336793 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a810cf-b69c-4c65-987b-53df06da3614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:01:13.362154 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Flow 'volume_create_manager' (6bfde16e-1931-4ca8-8dc4-54f7867b9117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:01:13.399436 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-92076e14-1c4c-4191-9ac3-cd526b7708ae tempest-DeleteServersTestJSON-1244431593 None] Created volume successfully. Oct 22 21:01:14.903978 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-a2cc0de8-5a04-4872-9d88-57eae01ac169 req-35e599dd-ed5f-481b-9d11-d25ce7918b0a tempest-DeleteServersTestJSON-1244431593 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:01:17.279496 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-a2cc0de8-5a04-4872-9d88-57eae01ac169 req-35e599dd-ed5f-481b-9d11-d25ce7918b0a tempest-DeleteServersTestJSON-1244431593 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.376s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:01:17.280346 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-a2cc0de8-5a04-4872-9d88-57eae01ac169 req-35e599dd-ed5f-481b-9d11-d25ce7918b0a tempest-DeleteServersTestJSON-1244431593 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5d2013d8-0420-4b76-9785-fd5fa05ccf6e', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '5d2013d8-0420-4b76-9785-fd5fa05ccf6e', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:01:17.324158 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-a2cc0de8-5a04-4872-9d88-57eae01ac169 req-35e599dd-ed5f-481b-9d11-d25ce7918b0a tempest-DeleteServersTestJSON-1244431593 None] Connection info returned from driver {'name': 'volumes/volume-5d2013d8-0420-4b76-9785-fd5fa05ccf6e', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5d2013d8-0420-4b76-9785-fd5fa05ccf6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '36eea80c-9411-408d-8085-e45cbfb12d21'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:01:17.428984 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-a2cc0de8-5a04-4872-9d88-57eae01ac169 req-35e599dd-ed5f-481b-9d11-d25ce7918b0a tempest-DeleteServersTestJSON-1244431593 None] attachment_update completed successfully. Oct 22 21:01:27.402656 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:27.612937 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=24,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:01:27.678921 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-129c3579-8ca9-422c-9ed6-b24be026d947 req-480176bd-e0d2-4504-965b-5e8ff43cc992 tempest-DeleteServersTestJSON-1244431593 None] Terminate volume connection completed successfully. Oct 22 21:01:27.679467 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-129c3579-8ca9-422c-9ed6-b24be026d947 req-480176bd-e0d2-4504-965b-5e8ff43cc992 tempest-DeleteServersTestJSON-1244431593 None] Deleting attachment 36eea80c-9411-408d-8085-e45cbfb12d21. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:01:30.457195 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:01:30.458096 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:01:30.597748 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:01:30.696920 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:01:45.146496 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:05.132167 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:25.120383 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:30.459432 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:02:30.460213 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:30.554758 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:30.634864 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:02:31.966057 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b0831776-de66-459f-be0c-09eb789f38d5 tempest-GroupsTest-538554293 None] Group tempest-Group1-2004697763: creating Oct 22 21:02:32.047740 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b0831776-de66-459f-be0c-09eb789f38d5 tempest-GroupsTest-538554293 None] Group tempest-Group1-2004697763: created successfully Oct 22 21:02:32.071520 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b0831776-de66-459f-be0c-09eb789f38d5 tempest-GroupsTest-538554293 None] Create group completed successfully. Oct 22 21:02:33.524397 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2c1e73f8-baaf-42ff-9fcd-3456527e2be5 tempest-GroupsTest-538554293 None] Group tempest-Group2-1899684597: creating Oct 22 21:02:33.586479 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2c1e73f8-baaf-42ff-9fcd-3456527e2be5 tempest-GroupsTest-538554293 None] Group tempest-Group2-1899684597: created successfully Oct 22 21:02:33.613547 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2c1e73f8-baaf-42ff-9fcd-3456527e2be5 tempest-GroupsTest-538554293 None] Create group completed successfully. Oct 22 21:02:35.702847 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:35.721029 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:02:35.744772 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Flow 'volume_create_manager' (a78db841-06a6-4ee0-b21d-fa5134b84036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:02:35.752683 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30409b3-ee09-4336-9361-4399c633d314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:35.782435 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30409b3-ee09-4336-9361-4399c633d314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1188763966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33c1fc80-7175-447d-8d8f-e1875867d5b2,host='ncdv-master-1@ceph#ceph',id=c7213f36-04e6-417a-9af4-6d1b75e9e798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332ddcce625b4783ae4fb619dc17557a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:02:36Z,use_quota=True,user_id='de0a1781de864d9b86cd127735640de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7bcfcf6-16a3-4c2b-a012-190a13710388),volume_type_id=c7bcfcf6-16a3-4c2b-a012-190a13710388)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:35.793133 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d7db25-2081-4043-b438-a3ddcb16cbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:35.806352 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d7db25-2081-4043-b438-a3ddcb16cbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:35.820277 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9344ce26-b22a-4f1b-a604-b0f30e76aaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:35.829968 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9344ce26-b22a-4f1b-a604-b0f30e76aaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7213f36-04e6-417a-9af4-6d1b75e9e798', 'volume_name': 'volume-c7213f36-04e6-417a-9af4-6d1b75e9e798', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:35.843639 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8fee99-35d8-4ab2-aabe-bd64b804ba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:35.855418 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8fee99-35d8-4ab2-aabe-bd64b804ba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:35.865343 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca34191-1466-40b0-9097-ee443f54cdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:35.869216 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Volume c7213f36-04e6-417a-9af4-6d1b75e9e798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7213f36-04e6-417a-9af4-6d1b75e9e798', 'volume_size': 1} Oct 22 21:02:35.870117 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] creating volume 'volume-c7213f36-04e6-417a-9af4-6d1b75e9e798' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:02:35.871049 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:36.022439 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:02:36.023231 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:02:36.029831 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca34191-1466-40b0-9097-ee443f54cdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7213f36-04e6-417a-9af4-6d1b75e9e798', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:36.040716 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6b6941-510f-4350-afb2-d56976885a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:36.071665 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Volume volume-c7213f36-04e6-417a-9af4-6d1b75e9e798 (c7213f36-04e6-417a-9af4-6d1b75e9e798): created successfully Oct 22 21:02:36.078436 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6b6941-510f-4350-afb2-d56976885a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:36.112998 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Flow 'volume_create_manager' (a78db841-06a6-4ee0-b21d-fa5134b84036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:02:36.138227 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-ddaea74b-33af-4e9d-ab10-5088031c15ca tempest-GroupsTest-538554293 None] Created volume successfully. Oct 22 21:02:37.753832 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:37.846403 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:02:37.854749 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] Volume volume-c7213f36-04e6-417a-9af4-6d1b75e9e798 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:02:37.878491 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] deleting rbd volume volume-c7213f36-04e6-417a-9af4-6d1b75e9e798 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:02:38.384895 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] Created reservations ['634922f7-bbda-45e9-854b-1b3eb349de21'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:02:38.416083 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1464389835 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1464389835, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:02:38.417301 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1464389835 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1464389835, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:02:38.444713 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] Created reservations ['9e88d342-0bd0-4c57-9e28-ee8f1fe2c3c1', '1c7c5b48-fda7-43a2-8131-379c6808ccc9', '98131b86-be8a-421a-a0ef-32ea81a66966', 'c5ecd2e8-44c5-438a-b476-a1d63a39d57d'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:02:38.674761 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:38.761732 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:38.823154 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:02:38.827632 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5e59814d-6c90-4515-b3ea-d026a7bbff0d tempest-GroupsTest-538554293 None] Delete group completed successfully. Oct 22 21:02:39.178638 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-0dacead1-4884-47f2-889b-4bd84e930fa9 tempest-GroupsTest-538554293 None] Created reservations ['0d16e7ff-d695-4304-83af-c663e4f15152'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:02:39.240734 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0dacead1-4884-47f2-889b-4bd84e930fa9 tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:39.306020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0dacead1-4884-47f2-889b-4bd84e930fa9 tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:39.382189 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-0dacead1-4884-47f2-889b-4bd84e930fa9 tempest-GroupsTest-538554293 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:02:39.387071 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-0dacead1-4884-47f2-889b-4bd84e930fa9 tempest-GroupsTest-538554293 None] Delete group completed successfully. Oct 22 21:02:41.275243 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-cc2408f3-e429-45ce-9622-4bab0b4ac144 tempest-GroupsTest-538554293 None] Group tempest-GroupsTest-Group-395351279: creating Oct 22 21:02:41.326918 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-cc2408f3-e429-45ce-9622-4bab0b4ac144 tempest-GroupsTest-538554293 None] Group tempest-GroupsTest-Group-395351279: created successfully Oct 22 21:02:41.371885 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-cc2408f3-e429-45ce-9622-4bab0b4ac144 tempest-GroupsTest-538554293 None] Create group completed successfully. Oct 22 21:02:43.224554 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:02:43.282054 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Flow 'volume_create_manager' (76be62cc-ede7-4602-833f-c22907116b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:02:43.292098 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e0e770-e843-4052-98fb-313bb2736986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:43.361813 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e0e770-e843-4052-98fb-313bb2736986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-788164879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a463970-7e84-41c9-af47-bb0c4df29956,host='ncdv-master-1@ceph#ceph',id=7a0a74a2-743c-4445-bef2-aebf0c3863d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332ddcce625b4783ae4fb619dc17557a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:02:43Z,use_quota=True,user_id='de0a1781de864d9b86cd127735640de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e566f5b3-b89d-4482-95cd-d91dfae5aa7d),volume_type_id=e566f5b3-b89d-4482-95cd-d91dfae5aa7d)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:43.373911 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89454384-abd4-435d-b24e-6b00610c9a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:43.388970 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89454384-abd4-435d-b24e-6b00610c9a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:43.395260 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32e2c65-08ed-469e-804e-077c249b0157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:43.410454 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32e2c65-08ed-469e-804e-077c249b0157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0a74a2-743c-4445-bef2-aebf0c3863d4', 'volume_name': 'volume-7a0a74a2-743c-4445-bef2-aebf0c3863d4', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:43.423283 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59260c1-09ff-4d57-9d31-17b2e671ba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:43.434527 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59260c1-09ff-4d57-9d31-17b2e671ba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:43.443069 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c43d42-6bbb-480a-8394-869fb2d73cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:43.454390 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Volume 7a0a74a2-743c-4445-bef2-aebf0c3863d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0a74a2-743c-4445-bef2-aebf0c3863d4', 'volume_size': 1} Oct 22 21:02:43.457000 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] creating volume 'volume-7a0a74a2-743c-4445-bef2-aebf0c3863d4' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:02:43.458794 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:43.606569 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:02:43.607231 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:02:43.611200 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c43d42-6bbb-480a-8394-869fb2d73cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0a74a2-743c-4445-bef2-aebf0c3863d4', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:43.619883 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6829384-ab73-4200-ad81-5543bc412d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:43.648161 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Volume volume-7a0a74a2-743c-4445-bef2-aebf0c3863d4 (7a0a74a2-743c-4445-bef2-aebf0c3863d4): created successfully Oct 22 21:02:43.659529 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6829384-ab73-4200-ad81-5543bc412d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:43.678981 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Flow 'volume_create_manager' (76be62cc-ede7-4602-833f-c22907116b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:02:43.698590 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-920be7fe-7ed0-4ca6-8149-376840c99531 tempest-GroupsTest-538554293 None] Created volume successfully. Oct 22 21:02:45.249649 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:02:45.308041 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Flow 'volume_create_manager' (dac48b72-3332-4a16-9a70-e7123282aa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:02:45.330890 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3925664-9c0d-4e38-a94c-c509c0643265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:45.385719 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3925664-9c0d-4e38-a94c-c509c0643265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1719913123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a463970-7e84-41c9-af47-bb0c4df29956,host='ncdv-master-1@ceph#ceph',id=14770124-4aaa-4833-bd9e-07d33955f8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332ddcce625b4783ae4fb619dc17557a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:02:45Z,use_quota=True,user_id='de0a1781de864d9b86cd127735640de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e566f5b3-b89d-4482-95cd-d91dfae5aa7d),volume_type_id=e566f5b3-b89d-4482-95cd-d91dfae5aa7d)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:45.399791 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f28a5f-dedf-4d51-9861-e10b9fa28f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:45.408577 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f28a5f-dedf-4d51-9861-e10b9fa28f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:45.423052 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edce218-03f7-4e3b-8205-e1bba4515ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:45.432018 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edce218-03f7-4e3b-8205-e1bba4515ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14770124-4aaa-4833-bd9e-07d33955f8c1', 'volume_name': 'volume-14770124-4aaa-4833-bd9e-07d33955f8c1', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:45.452750 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db12e93-d25d-45ee-97f1-83285efbb525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:45.466832 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db12e93-d25d-45ee-97f1-83285efbb525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:45.481656 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a17121-007c-43bc-99f2-e21fc4a0c262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:45.483899 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Volume 14770124-4aaa-4833-bd9e-07d33955f8c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14770124-4aaa-4833-bd9e-07d33955f8c1', 'volume_size': 1} Oct 22 21:02:45.486085 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] creating volume 'volume-14770124-4aaa-4833-bd9e-07d33955f8c1' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:02:45.486927 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:45.664438 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:02:45.665019 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:02:45.669124 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a17121-007c-43bc-99f2-e21fc4a0c262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14770124-4aaa-4833-bd9e-07d33955f8c1', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:45.679470 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5013795b-1836-49b9-aed3-1b3d94ff2441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:45.711056 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Volume volume-14770124-4aaa-4833-bd9e-07d33955f8c1 (14770124-4aaa-4833-bd9e-07d33955f8c1): created successfully Oct 22 21:02:45.724611 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5013795b-1836-49b9-aed3-1b3d94ff2441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:45.749929 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Flow 'volume_create_manager' (dac48b72-3332-4a16-9a70-e7123282aa81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:02:45.781495 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d80ca030-27ce-4485-9f2d-33b252027a91 tempest-GroupsTest-538554293 None] Created volume successfully. Oct 22 21:02:46.828356 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-904f6aef-8578-41eb-90d8-36ad0b6892a6 tempest-GroupsTest-538554293 None] Update group completed successfully. Oct 22 21:02:48.298764 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7796d00c-8e1b-4649-9feb-0c9ffcc5f818 tempest-GroupsTest-538554293 None] Update group completed successfully. Oct 22 21:02:49.891810 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:49.998080 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:02:49.998520 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] Volume volume-14770124-4aaa-4833-bd9e-07d33955f8c1 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:02:50.004644 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] deleting rbd volume volume-14770124-4aaa-4833-bd9e-07d33955f8c1 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:02:50.362750 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:50.493263 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:02:50.496967 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] Volume volume-7a0a74a2-743c-4445-bef2-aebf0c3863d4 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:02:50.515798 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] deleting rbd volume volume-7a0a74a2-743c-4445-bef2-aebf0c3863d4 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:02:50.952920 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] Created reservations ['ac453ad0-c26d-4cc3-a945-e6d1fad143e9'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:02:51.006085 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=66,cinder:DELETE=2,cinder:UPDATE=28,cinder:INSERT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:51.016644 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1699193999 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1699193999, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:02:51.018153 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1699193999 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1699193999, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:02:51.030397 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=77,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:02:51.066741 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] Created reservations ['70367bd9-ea89-4c74-8c6a-22f79fa6a51d', '5384d30d-1684-4a89-8413-c8d744e86727', 'f38ecd06-c5d0-4e03-9ee6-99d775e02c29', '2601f87e-b6d2-4741-9bd3-75ff15da80dc'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:02:51.269924 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] Created reservations ['89d042e1-e913-47a4-8181-32bc73848d04', '05731d76-554e-4431-94da-1c8384e57f69', '61a96a93-dbd5-440f-bcdc-10a564fb26c4', '44d0de7b-9b0f-4d8a-b6df-526d69b2b449'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:02:51.375408 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:51.449393 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:51.514681 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:02:51.519151 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a7d6f597-1045-4b4d-a59d-fdee4e04f2be tempest-GroupsTest-538554293 None] Delete group completed successfully. Oct 22 21:02:58.444295 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-480c3e68-00bf-4d6a-8998-342d4c05c037 tempest-GroupsV314Test-1867806548 None] Group tempest-GroupsV314Test-Group-247476489: creating Oct 22 21:02:58.464505 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-480c3e68-00bf-4d6a-8998-342d4c05c037 tempest-GroupsV314Test-1867806548 None] Group tempest-GroupsV314Test-Group-247476489: created successfully Oct 22 21:02:58.473971 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-480c3e68-00bf-4d6a-8998-342d4c05c037 tempest-GroupsV314Test-1867806548 None] Create group completed successfully. Oct 22 21:02:59.525631 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:02:59.555855 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Flow 'volume_create_manager' (8407cee8-4282-4532-bfd5-f74a34e8d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:02:59.563554 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feacfd90-d399-4ec0-8906-595c12545a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:59.580723 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feacfd90-d399-4ec0-8906-595c12545a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-408699379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3e81cd34-c751-4f9b-9471-bf4a26c3d24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7c0508d9704887bdb3e856986a00af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:02:59Z,use_quota=True,user_id='6089cb1748d54e53a533082e64165ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:59.586077 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244ddbc5-dd39-460e-8cb6-d370a82b1901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:59.590250 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244ddbc5-dd39-460e-8cb6-d370a82b1901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:59.595158 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35148c9e-2211-4446-8dc4-06d15f17e72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:59.599440 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35148c9e-2211-4446-8dc4-06d15f17e72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e81cd34-c751-4f9b-9471-bf4a26c3d24b', 'volume_name': 'volume-3e81cd34-c751-4f9b-9471-bf4a26c3d24b', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:59.604839 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c500f6f4-8100-4a0d-b0e1-f8cfbe607408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:59.609263 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c500f6f4-8100-4a0d-b0e1-f8cfbe607408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:59.614039 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792cd6ad-3cc8-4b51-8e9d-5cfbfcc8dbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:59.615299 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Volume 3e81cd34-c751-4f9b-9471-bf4a26c3d24b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e81cd34-c751-4f9b-9471-bf4a26c3d24b', 'volume_size': 1} Oct 22 21:02:59.615944 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] creating volume 'volume-3e81cd34-c751-4f9b-9471-bf4a26c3d24b' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:02:59.616944 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:02:59.722091 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:02:59.723039 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:02:59.729397 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792cd6ad-3cc8-4b51-8e9d-5cfbfcc8dbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e81cd34-c751-4f9b-9471-bf4a26c3d24b', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:59.737344 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b0e789-d072-4947-acad-474bd52a8a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:02:59.757279 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Volume volume-3e81cd34-c751-4f9b-9471-bf4a26c3d24b (3e81cd34-c751-4f9b-9471-bf4a26c3d24b): created successfully Oct 22 21:02:59.768438 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b0e789-d072-4947-acad-474bd52a8a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:02:59.774200 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Flow 'volume_create_manager' (8407cee8-4282-4532-bfd5-f74a34e8d300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:02:59.795204 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-25082c24-7531-4e5f-b990-264923c36b39 tempest-VolumesServicesTestJSON-1087287763 None] Created volume successfully. Oct 22 21:03:00.188799 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:03:00.211366 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Flow 'volume_create_manager' (652c3bdc-a5ac-4c3a-a19d-adb249ff5d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:00.218318 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b1f8d2-b8c6-4f23-b3df-124e12c03d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:00.238965 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b1f8d2-b8c6-4f23-b3df-124e12c03d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1994773288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=26a758a7-8019-403f-a854-03bf2fc664d5,host='ncdv-master-1@ceph#ceph',id=0fed65df-2201-4d94-8c06-94c3d41a9d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ab79cc2f4340259e6753887c8fc867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:03:00Z,use_quota=True,user_id='9954d9e32fe144fda47fee534ce1c90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f3ed695-96c3-4a0b-a174-895983b9c949),volume_type_id=1f3ed695-96c3-4a0b-a174-895983b9c949)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:00.245050 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa20cd2c-76aa-4d82-b2a2-8302a384d31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:00.249517 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa20cd2c-76aa-4d82-b2a2-8302a384d31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:00.256246 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b32087-46d9-490f-a753-09ee0d62246f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:00.261687 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b32087-46d9-490f-a753-09ee0d62246f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fed65df-2201-4d94-8c06-94c3d41a9d7f', 'volume_name': 'volume-0fed65df-2201-4d94-8c06-94c3d41a9d7f', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:00.266281 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3dfde4-75ab-470e-b730-52a8e08a8674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:00.269971 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3dfde4-75ab-470e-b730-52a8e08a8674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:00.274814 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616e80a2-02d2-4cdf-959b-fbb6e89500a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:00.275932 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Volume 0fed65df-2201-4d94-8c06-94c3d41a9d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fed65df-2201-4d94-8c06-94c3d41a9d7f', 'volume_size': 1} Oct 22 21:03:00.276324 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] creating volume 'volume-0fed65df-2201-4d94-8c06-94c3d41a9d7f' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:03:00.276973 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:00.372684 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:03:00.373340 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:03:00.377257 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616e80a2-02d2-4cdf-959b-fbb6e89500a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fed65df-2201-4d94-8c06-94c3d41a9d7f', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:00.387981 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c11ddcb-8a97-47f1-a940-841b8df92bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:00.402487 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Volume volume-0fed65df-2201-4d94-8c06-94c3d41a9d7f (0fed65df-2201-4d94-8c06-94c3d41a9d7f): created successfully Oct 22 21:03:00.407072 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c11ddcb-8a97-47f1-a940-841b8df92bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:00.420235 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Flow 'volume_create_manager' (652c3bdc-a5ac-4c3a-a19d-adb249ff5d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:00.434471 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a438cdf7-e203-4fa9-b6d9-95412cfa6e28 tempest-GroupsV314Test-1867806548 None] Created volume successfully. Oct 22 21:03:00.653660 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] Acquiring lock "cinder-3e81cd34-c751-4f9b-9471-bf4a26c3d24b-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:03:00.671263 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] Lock "cinder-3e81cd34-c751-4f9b-9471-bf4a26c3d24b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:03:00.742564 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:00.814861 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:03:00.815412 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] Volume volume-3e81cd34-c751-4f9b-9471-bf4a26c3d24b is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:03:00.820615 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] deleting rbd volume volume-3e81cd34-c751-4f9b-9471-bf4a26c3d24b {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:03:01.112426 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] Created reservations ['79c5a43a-70b9-4d70-901f-5b12db223adf', '2cdc4e1f-20df-4d94-8f61-f93ff00c174f', '469c55b3-e547-44d4-8549-32b92ebe6b24', 'c4e82e67-d0aa-4572-b373-aecfe76439e4'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:03:01.171918 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:01.209995 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:01.255741 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:03:01.268539 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] Deleted volume successfully. Oct 22 21:03:01.285888 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-493f98ca-3038-47d4-bb40-48d1f86449c1 tempest-VolumesServicesTestJSON-1087287763 None] Lock "cinder-3e81cd34-c751-4f9b-9471-bf4a26c3d24b-delete_volume" released by "delete_volume" :: held 0.614s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:03:01.881471 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e332f821-f5ce-4392-9570-27409a17a8ad tempest-GroupsV314Test-1867806548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:01.941060 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e332f821-f5ce-4392-9570-27409a17a8ad tempest-GroupsV314Test-1867806548 None] creating snapshot='volume-36d0b202-5651-482b-898f-1d2bdcc21e03.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:03:02.497048 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e332f821-f5ce-4392-9570-27409a17a8ad tempest-GroupsV314Test-1867806548 None] cloning 'volume-0fed65df-2201-4d94-8c06-94c3d41a9d7f@volume-36d0b202-5651-482b-898f-1d2bdcc21e03.clone_snap' to 'volume-36d0b202-5651-482b-898f-1d2bdcc21e03' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:03:02.621115 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e332f821-f5ce-4392-9570-27409a17a8ad tempest-GroupsV314Test-1867806548 None] Volume volume-0fed65df-2201-4d94-8c06-94c3d41a9d7f is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:03:02.630545 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e332f821-f5ce-4392-9570-27409a17a8ad tempest-GroupsV314Test-1867806548 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:03:02.630914 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e332f821-f5ce-4392-9570-27409a17a8ad tempest-GroupsV314Test-1867806548 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:03:02.675238 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e332f821-f5ce-4392-9570-27409a17a8ad tempest-GroupsV314Test-1867806548 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:03:02.751159 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e332f821-f5ce-4392-9570-27409a17a8ad tempest-GroupsV314Test-1867806548 None] Create group from source-group-26a758a7-8019-403f-a854-03bf2fc664d5 completed successfully. Oct 22 21:03:03.562569 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=56,cinder:INSERT=8,cinder:UPDATE=36 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:03.604303 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:03.690410 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:03:03.697932 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] deleting rbd volume volume-36d0b202-5651-482b-898f-1d2bdcc21e03 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:03:03.954471 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:03:03.981505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] Volume volume-0fed65df-2201-4d94-8c06-94c3d41a9d7f is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:03:03.982332 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] deleting parent snapshot volume-36d0b202-5651-482b-898f-1d2bdcc21e03.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:03:04.611906 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] Created reservations ['5631cab0-1154-4f3e-aeae-0aa4f61004d1'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:03:04.633257 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1492684568 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1492684568, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:03:04.634417 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1492684568 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1492684568, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:03:04.651832 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] Created reservations ['29d6680e-fb40-445a-9276-8bc77231d863', '96f3f46b-df1c-4b81-b582-2eee03d8cca4', '66bea2e3-8338-4c6b-8fb5-afc1144a0063', '8006424f-6122-4705-be21-89fedff880ca'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:03:04.678985 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=58,cinder:INSERT=7,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:04.770185 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:04.810747 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:04.855463 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:03:04.859616 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-20a8019c-8421-45d1-aaca-acc40864f2df tempest-GroupsV314Test-1867806548 None] Delete group completed successfully. Oct 22 21:03:05.409204 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:03:05.449860 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Flow 'volume_create_manager' (28e54d54-c848-421d-beb6-b1e3a4678081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:05.460282 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e6ef8f-4e9a-4b3e-8947-94fe39199e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:05.494412 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e6ef8f-4e9a-4b3e-8947-94fe39199e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-3981808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4899c6ec-487a-42e7-83a0-6bd293e33747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a836f4dac6d4bff8d4090acd1431363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:03:05Z,use_quota=True,user_id='d624fc14cd5d4ec084bd284ae1120e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:05.501710 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c047b0-9101-4d89-b812-8d3a0d7ccb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:05.505906 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c047b0-9101-4d89-b812-8d3a0d7ccb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:05.511516 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7000951e-126d-4736-bfe7-be9d44ebd8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:05.518005 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7000951e-126d-4736-bfe7-be9d44ebd8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4899c6ec-487a-42e7-83a0-6bd293e33747', 'volume_name': 'volume-4899c6ec-487a-42e7-83a0-6bd293e33747', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:05.523152 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a56200-d0b3-4781-9fe9-e8cb51e31e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:05.534444 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a56200-d0b3-4781-9fe9-e8cb51e31e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:05.544435 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6ecce2-da26-4d1f-b999-44733d893f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:05.545548 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Volume 4899c6ec-487a-42e7-83a0-6bd293e33747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4899c6ec-487a-42e7-83a0-6bd293e33747', 'volume_size': 1} Oct 22 21:03:05.545950 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] creating volume 'volume-4899c6ec-487a-42e7-83a0-6bd293e33747' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:03:05.546735 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:05.672423 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:03:05.672992 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:03:05.676677 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6ecce2-da26-4d1f-b999-44733d893f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4899c6ec-487a-42e7-83a0-6bd293e33747', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:05.681846 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6717b9-9026-4e4e-9abf-c70a1c6d448d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:05.693776 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Volume volume-4899c6ec-487a-42e7-83a0-6bd293e33747 (4899c6ec-487a-42e7-83a0-6bd293e33747): created successfully Oct 22 21:03:05.697966 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6717b9-9026-4e4e-9abf-c70a1c6d448d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:05.703756 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Flow 'volume_create_manager' (28e54d54-c848-421d-beb6-b1e3a4678081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:05.715718 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b12d7d14-a3c2-46e6-b643-b4b1cfd0b33e tempest-VolumesBackupsV39Test-1671264096 None] Created volume successfully. Oct 22 21:03:06.001511 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16ad8e53-32a0-43e1-99b3-47b4a84304ab tempest-GroupsV314Test-1867806548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:06.056556 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16ad8e53-32a0-43e1-99b3-47b4a84304ab tempest-GroupsV314Test-1867806548 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:03:06.056989 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16ad8e53-32a0-43e1-99b3-47b4a84304ab tempest-GroupsV314Test-1867806548 None] Volume volume-0fed65df-2201-4d94-8c06-94c3d41a9d7f is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:03:06.062958 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16ad8e53-32a0-43e1-99b3-47b4a84304ab tempest-GroupsV314Test-1867806548 None] deleting rbd volume volume-0fed65df-2201-4d94-8c06-94c3d41a9d7f {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:03:06.379138 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-16ad8e53-32a0-43e1-99b3-47b4a84304ab tempest-GroupsV314Test-1867806548 None] Created reservations ['603733ab-5f8c-4a62-8710-3b7a10329646'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:03:06.415445 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-16ad8e53-32a0-43e1-99b3-47b4a84304ab tempest-GroupsV314Test-1867806548 None] Created reservations ['b9cc8568-aea4-4799-9590-759b94a67edb', 'a4cd99c4-a73b-4ea3-819c-15bc1b5876ee', 'cef24ded-377a-4ad2-9ca6-d72246d16aaf', 'a77f766c-e290-4ebe-a741-a663ed47fddb'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:03:06.509553 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16ad8e53-32a0-43e1-99b3-47b4a84304ab tempest-GroupsV314Test-1867806548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:06.567737 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16ad8e53-32a0-43e1-99b3-47b4a84304ab tempest-GroupsV314Test-1867806548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:06.620703 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-16ad8e53-32a0-43e1-99b3-47b4a84304ab tempest-GroupsV314Test-1867806548 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:03:06.625314 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-16ad8e53-32a0-43e1-99b3-47b4a84304ab tempest-GroupsV314Test-1867806548 None] Delete group completed successfully. Oct 22 21:03:07.053971 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f7d8f00e-a227-401f-974b-7d2a5aa1effa tempest-VolumesBackupsV39Test-1671264096 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-22T21:03:06Z,data_timestamp=2022-10-22T21:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1185070540',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=d5192da8-fd29-4a64-a087-b4ddd0034d53,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4a836f4dac6d4bff8d4090acd1431363',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d624fc14cd5d4ec084bd284ae1120e55',volume_id=4899c6ec-487a-42e7-83a0-6bd293e33747) Oct 22 21:03:07.061810 ncdv-master-1 cinder-volume[131630]: INFO cinder.rpc [None req-f7d8f00e-a227-401f-974b-7d2a5aa1effa tempest-VolumesBackupsV39Test-1671264096 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Oct 22 21:03:07.067577 ncdv-master-1 cinder-volume[131630]: INFO cinder.rpc [None req-f7d8f00e-a227-401f-974b-7d2a5aa1effa tempest-VolumesBackupsV39Test-1671264096 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Oct 22 21:03:07.068494 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.backup.rpcapi [None req-f7d8f00e-a227-401f-974b-7d2a5aa1effa tempest-VolumesBackupsV39Test-1671264096 None] continue_backup in rpcapi backup_id d5192da8-fd29-4a64-a087-b4ddd0034d53 {{(pid=131630) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Oct 22 21:03:11.145425 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-f7d8f00e-a227-401f-974b-7d2a5aa1effa tempest-VolumesBackupsV39Test-1671264096 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:03:12.052489 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-f7d8f00e-a227-401f-974b-7d2a5aa1effa tempest-VolumesBackupsV39Test-1671264096 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.906s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:03:12.054411 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f7d8f00e-a227-401f-974b-7d2a5aa1effa tempest-VolumesBackupsV39Test-1671264096 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4899c6ec-487a-42e7-83a0-6bd293e33747', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '4899c6ec-487a-42e7-83a0-6bd293e33747', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:03:12.079629 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f7d8f00e-a227-401f-974b-7d2a5aa1effa tempest-VolumesBackupsV39Test-1671264096 None] Initialize volume connection completed successfully. Oct 22 21:03:15.932315 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f7d8f00e-a227-401f-974b-7d2a5aa1effa tempest-VolumesBackupsV39Test-1671264096 None] Terminate volume connection completed successfully. Oct 22 21:03:15.959761 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f7d8f00e-a227-401f-974b-7d2a5aa1effa tempest-VolumesBackupsV39Test-1671264096 None] Remove volume export completed successfully. Oct 22 21:03:19.271376 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-86900451-3738-4d3a-870b-4f2efddc6dff tempest-VolumesBackupsV39Test-1671264096 None] Acquiring lock "cinder-4899c6ec-487a-42e7-83a0-6bd293e33747-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:03:19.303955 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-86900451-3738-4d3a-870b-4f2efddc6dff tempest-VolumesBackupsV39Test-1671264096 None] Lock "cinder-4899c6ec-487a-42e7-83a0-6bd293e33747-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:03:19.438965 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-86900451-3738-4d3a-870b-4f2efddc6dff tempest-VolumesBackupsV39Test-1671264096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:19.748986 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-86900451-3738-4d3a-870b-4f2efddc6dff tempest-VolumesBackupsV39Test-1671264096 None] Volume volume-4899c6ec-487a-42e7-83a0-6bd293e33747 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:03:19.822922 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-86900451-3738-4d3a-870b-4f2efddc6dff tempest-VolumesBackupsV39Test-1671264096 None] deleting rbd volume volume-4899c6ec-487a-42e7-83a0-6bd293e33747 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:03:20.687483 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-86900451-3738-4d3a-870b-4f2efddc6dff tempest-VolumesBackupsV39Test-1671264096 None] Created reservations ['980cf229-d70b-44d8-ba78-f15071a70eaf', '6a07a08a-2de7-4682-93d5-4d4561d6ba10', '4080277f-14b1-4084-b09b-fe71c7e85928', 'da6d5aee-966f-4e1c-aee9-825d02e7df85'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:03:20.737500 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=63,cinder:UPDATE=32,cinder:INSERT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:20.876123 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-86900451-3738-4d3a-870b-4f2efddc6dff tempest-VolumesBackupsV39Test-1671264096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:21.033159 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-86900451-3738-4d3a-870b-4f2efddc6dff tempest-VolumesBackupsV39Test-1671264096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:21.161062 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-86900451-3738-4d3a-870b-4f2efddc6dff tempest-VolumesBackupsV39Test-1671264096 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:03:21.167708 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-86900451-3738-4d3a-870b-4f2efddc6dff tempest-VolumesBackupsV39Test-1671264096 None] Deleted volume successfully. Oct 22 21:03:21.205291 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-86900451-3738-4d3a-870b-4f2efddc6dff tempest-VolumesBackupsV39Test-1671264096 None] Lock "cinder-4899c6ec-487a-42e7-83a0-6bd293e33747-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:03:30.068486 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:03:30.126299 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Flow 'volume_create_manager' (ec51162a-d849-483b-bed9-1feb052875a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:30.140539 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008efdad-0968-4cf2-a465-9eec9a3d8360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:30.187883 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008efdad-0968-4cf2-a465-9eec9a3d8360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-130633755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cfe6786e-4ce1-447c-9c53-fde86db7f27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f4629adedbe4b2290896c3fc9ab46c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:03:30Z,use_quota=True,user_id='128f1d640175439c915b50231021cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:30.203820 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d21cf19-984c-4ce8-8a02-740a601c7654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:30.214351 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d21cf19-984c-4ce8-8a02-740a601c7654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:30.227666 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b718b0-6a7e-4180-b25e-636ee58c01c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:30.237866 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b718b0-6a7e-4180-b25e-636ee58c01c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe6786e-4ce1-447c-9c53-fde86db7f27e', 'volume_name': 'volume-cfe6786e-4ce1-447c-9c53-fde86db7f27e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:30.251187 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7730e67f-b893-4e77-8a6e-432f0d4dd843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:30.264928 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7730e67f-b893-4e77-8a6e-432f0d4dd843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:30.270545 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33309af3-446c-4f1f-8f64-4860d2c9ebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:30.275170 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Volume cfe6786e-4ce1-447c-9c53-fde86db7f27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe6786e-4ce1-447c-9c53-fde86db7f27e', 'volume_size': 1} Oct 22 21:03:30.276012 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] creating volume 'volume-cfe6786e-4ce1-447c-9c53-fde86db7f27e' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:03:30.282182 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:30.460419 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:03:30.461138 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:03:30.465663 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33309af3-446c-4f1f-8f64-4860d2c9ebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe6786e-4ce1-447c-9c53-fde86db7f27e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:30.474091 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8eb740-8069-4031-b770-2ae6d9867af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:30.506943 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:03:30.510524 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:30.655878 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Volume volume-cfe6786e-4ce1-447c-9c53-fde86db7f27e (cfe6786e-4ce1-447c-9c53-fde86db7f27e): created successfully Oct 22 21:03:30.659437 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8eb740-8069-4031-b770-2ae6d9867af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:30.671877 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Flow 'volume_create_manager' (ec51162a-d849-483b-bed9-1feb052875a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:30.676783 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:30.755193 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:03:30.766625 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-ec175be0-a6da-498e-90a3-6989dd92aa39 tempest-AbsoluteLimitsTests-848612669 None] Created volume successfully. Oct 22 21:03:31.346783 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] Acquiring lock "cinder-cfe6786e-4ce1-447c-9c53-fde86db7f27e-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:03:31.358965 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] Lock "cinder-cfe6786e-4ce1-447c-9c53-fde86db7f27e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:03:31.488472 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:31.592893 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:03:31.593588 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] Volume volume-cfe6786e-4ce1-447c-9c53-fde86db7f27e is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:03:31.620402 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] deleting rbd volume volume-cfe6786e-4ce1-447c-9c53-fde86db7f27e {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:03:32.272084 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=64,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:32.298207 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] Created reservations ['eccaa64c-5594-4d70-8869-1cab3d38e427', '5b89cf10-eed8-4d19-b217-d58e00db7bdd', 'ace13069-c8c2-4610-b235-db4f0589b8c7', 'e232f6e5-602a-452f-b411-fd2bfe6720dc'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:03:32.416689 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:32.537945 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:32.689169 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:03:32.694365 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] Deleted volume successfully. Oct 22 21:03:32.716955 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d35474a9-d0f8-40c7-b282-7a65d7d11ce2 tempest-AbsoluteLimitsTests-848612669 None] Lock "cinder-cfe6786e-4ce1-447c-9c53-fde86db7f27e-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:03:44.943749 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:03:44.988913 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Flow 'volume_create_manager' (58fcba86-182a-4d0b-a98c-03809c2386d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:45.002917 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43c693c-e978-4a0a-8191-63cee086a702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:45.051001 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43c693c-e978-4a0a-8191-63cee086a702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1595172219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b5b54cd2-5ca4-423c-92ff-1bd0563e126d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='331abcc623904e2c9247a4911df2efe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:03:45Z,use_quota=True,user_id='02a2f87a80924b47a47a7e6d0ef2da74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:45.067081 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf0d7d3-e8c9-4ba5-8ea7-846cf49af0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:45.074602 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf0d7d3-e8c9-4ba5-8ea7-846cf49af0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:45.087486 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe05717-83be-404f-969c-2d299a79e968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:45.100119 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe05717-83be-404f-969c-2d299a79e968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b54cd2-5ca4-423c-92ff-1bd0563e126d', 'volume_name': 'volume-b5b54cd2-5ca4-423c-92ff-1bd0563e126d', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:45.113225 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b189467d-296f-4a3b-9aff-007ebb7c1dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:45.120167 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b189467d-296f-4a3b-9aff-007ebb7c1dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:45.133851 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043c3c9c-789e-44bc-9073-159096a11cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:45.136414 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Volume b5b54cd2-5ca4-423c-92ff-1bd0563e126d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b54cd2-5ca4-423c-92ff-1bd0563e126d', 'volume_size': 1} Oct 22 21:03:45.137358 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] creating volume 'volume-b5b54cd2-5ca4-423c-92ff-1bd0563e126d' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:03:45.139044 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:45.346862 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:03:45.347715 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:03:45.352754 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043c3c9c-789e-44bc-9073-159096a11cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b54cd2-5ca4-423c-92ff-1bd0563e126d', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:45.357782 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9e178b-2356-463c-bdf5-e594d0a51ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:45.416549 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Volume volume-b5b54cd2-5ca4-423c-92ff-1bd0563e126d (b5b54cd2-5ca4-423c-92ff-1bd0563e126d): created successfully Oct 22 21:03:45.420147 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9e178b-2356-463c-bdf5-e594d0a51ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:45.427856 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Flow 'volume_create_manager' (58fcba86-182a-4d0b-a98c-03809c2386d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:45.448912 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d9913193-58f8-4c89-bc2e-75db48c0af92 tempest-VolumesListTestJSON-366220154 None] Created volume successfully. Oct 22 21:03:47.021547 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:03:47.057717 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Flow 'volume_create_manager' (12fa76b9-cf2c-47b8-a24a-284bed630db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:47.085140 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4dcfc4-6638-4a64-b5d3-efd9e6310237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:47.124698 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4dcfc4-6638-4a64-b5d3-efd9e6310237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-949244336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=68d752e7-5e92-4558-a2d4-c13fcbc9134a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='331abcc623904e2c9247a4911df2efe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:03:47Z,use_quota=True,user_id='02a2f87a80924b47a47a7e6d0ef2da74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:47.140606 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da675c2-f1bc-4de9-87d9-8172f8bdd52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:47.149492 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da675c2-f1bc-4de9-87d9-8172f8bdd52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:47.154601 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e4c341-35aa-40f2-9bbc-b133c8ff29aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:47.158505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e4c341-35aa-40f2-9bbc-b133c8ff29aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d752e7-5e92-4558-a2d4-c13fcbc9134a', 'volume_name': 'volume-68d752e7-5e92-4558-a2d4-c13fcbc9134a', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:47.165355 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce2c6dc-1fd4-4621-95a2-1e276d6b01e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:47.169582 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce2c6dc-1fd4-4621-95a2-1e276d6b01e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:47.174939 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039c2f88-d701-44db-a2b9-1d21f97f12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:47.176410 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Volume 68d752e7-5e92-4558-a2d4-c13fcbc9134a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d752e7-5e92-4558-a2d4-c13fcbc9134a', 'volume_size': 1} Oct 22 21:03:47.176987 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] creating volume 'volume-68d752e7-5e92-4558-a2d4-c13fcbc9134a' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:03:47.177827 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:47.355070 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:03:47.355860 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:03:47.361891 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039c2f88-d701-44db-a2b9-1d21f97f12c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d752e7-5e92-4558-a2d4-c13fcbc9134a', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:47.378554 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3c663f-5830-4e70-9408-2e1343394f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:47.394395 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Volume volume-68d752e7-5e92-4558-a2d4-c13fcbc9134a (68d752e7-5e92-4558-a2d4-c13fcbc9134a): created successfully Oct 22 21:03:47.398947 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3c663f-5830-4e70-9408-2e1343394f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:47.411370 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Flow 'volume_create_manager' (12fa76b9-cf2c-47b8-a24a-284bed630db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:47.454143 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-69cda4d5-f2c7-4601-9c13-3d997b99c9f6 tempest-VolumesListTestJSON-366220154 None] Created volume successfully. Oct 22 21:03:48.988652 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:03:49.055953 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Flow 'volume_create_manager' (1bd4ef0f-f521-4472-9dd7-81eed57465f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:49.072591 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d43e6f3-003b-4409-8d21-ad8d867a3104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:49.124059 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d43e6f3-003b-4409-8d21-ad8d867a3104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-605582836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c2b64a96-c55a-4159-ba67-f087f8876c1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='331abcc623904e2c9247a4911df2efe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:03:49Z,use_quota=True,user_id='02a2f87a80924b47a47a7e6d0ef2da74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:49.145877 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0cba43-89a5-4380-a64f-b9d481dd133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:49.151497 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0cba43-89a5-4380-a64f-b9d481dd133e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:49.166738 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa0645d-40a5-4bed-a5f1-8ee5d9d9aaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:49.191456 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa0645d-40a5-4bed-a5f1-8ee5d9d9aaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b64a96-c55a-4159-ba67-f087f8876c1b', 'volume_name': 'volume-c2b64a96-c55a-4159-ba67-f087f8876c1b', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:49.196214 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2befe419-f03f-4342-a508-4f3413f04b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:49.206617 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2befe419-f03f-4342-a508-4f3413f04b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:49.222538 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e91cf7-4213-4b50-870e-819dd776017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:49.227630 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Volume c2b64a96-c55a-4159-ba67-f087f8876c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b64a96-c55a-4159-ba67-f087f8876c1b', 'volume_size': 1} Oct 22 21:03:49.228363 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] creating volume 'volume-c2b64a96-c55a-4159-ba67-f087f8876c1b' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:03:49.229211 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:49.396106 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:03:49.397186 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:03:49.401524 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e91cf7-4213-4b50-870e-819dd776017d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b64a96-c55a-4159-ba67-f087f8876c1b', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:49.411554 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17065c0-2d20-4c80-adea-aebed601c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:03:49.434877 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Volume volume-c2b64a96-c55a-4159-ba67-f087f8876c1b (c2b64a96-c55a-4159-ba67-f087f8876c1b): created successfully Oct 22 21:03:49.446359 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17065c0-2d20-4c80-adea-aebed601c681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:03:49.463519 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Flow 'volume_create_manager' (1bd4ef0f-f521-4472-9dd7-81eed57465f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:03:49.490712 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-cb19da29-5b1f-4748-913a-7ba1c328028c tempest-VolumesListTestJSON-366220154 None] Created volume successfully. Oct 22 21:03:55.260730 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=20,cinder:SELECT=34,cinder:INSERT=3,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:03:57.893064 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] Acquiring lock "cinder-c2b64a96-c55a-4159-ba67-f087f8876c1b-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:03:57.924207 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] Lock "cinder-c2b64a96-c55a-4159-ba67-f087f8876c1b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:03:58.062133 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:58.182957 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:03:58.183568 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] Volume volume-c2b64a96-c55a-4159-ba67-f087f8876c1b is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:03:58.197722 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] deleting rbd volume volume-c2b64a96-c55a-4159-ba67-f087f8876c1b {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:03:58.805241 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] Created reservations ['fa480cc5-62da-4c63-859d-9126ac2cd564', 'a88bfbe0-0d4d-4381-8b8c-7f4d8e6324f1', '2ab8f327-38e6-4cfb-aadf-48d85ce99dfd', 'f715fed2-6917-4a0c-9d55-dcf32ffd162c'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:03:58.953161 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:59.053035 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:59.160820 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:03:59.188575 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] Deleted volume successfully. Oct 22 21:03:59.221183 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-53888fdc-43fb-43fa-9ca4-5cbce65cba42 tempest-VolumesListTestJSON-366220154 None] Lock "cinder-c2b64a96-c55a-4159-ba67-f087f8876c1b-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:03:59.321395 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] Acquiring lock "cinder-68d752e7-5e92-4558-a2d4-c13fcbc9134a-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:03:59.345838 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] Lock "cinder-68d752e7-5e92-4558-a2d4-c13fcbc9134a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:03:59.465449 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:03:59.575535 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:03:59.576144 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] Volume volume-68d752e7-5e92-4558-a2d4-c13fcbc9134a is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:03:59.591883 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] deleting rbd volume volume-68d752e7-5e92-4558-a2d4-c13fcbc9134a {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:04:00.440061 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] Created reservations ['0b53677a-e0c7-4bfe-b9ed-dbcb7529d0e0', 'bf1052d2-7dc1-433a-a818-6815d6d9ba5e', 'e5eedaba-517d-428d-848c-4d1ee8b466d9', 'e52c98e3-ce3f-4378-baa9-197bfe7aab29'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:04:00.506548 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:00.602879 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:00.690043 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:04:00.699143 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] Acquiring lock "cinder-b5b54cd2-5ca4-423c-92ff-1bd0563e126d-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:04:00.705030 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] Deleted volume successfully. Oct 22 21:04:00.742906 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] Lock "cinder-b5b54cd2-5ca4-423c-92ff-1bd0563e126d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:04:00.748163 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-00e0e3ab-a406-4a44-8570-562b9dc9e369 tempest-VolumesListTestJSON-366220154 None] Lock "cinder-68d752e7-5e92-4558-a2d4-c13fcbc9134a-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:04:00.802631 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:00.894595 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:04:00.895026 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] Volume volume-b5b54cd2-5ca4-423c-92ff-1bd0563e126d is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:04:00.911469 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] deleting rbd volume volume-b5b54cd2-5ca4-423c-92ff-1bd0563e126d {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:04:01.423897 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] Created reservations ['943f6c6d-2fe6-46f8-a3ac-65fd8c1bdb29', 'd4a30c7d-2be5-4d3a-b44f-542502df78c7', '185f814e-65e2-49b5-a288-62775a104a8d', 'b9d13aa9-b4d2-4809-85bd-048292957638'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:04:01.506185 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:01.608711 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:01.680338 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:04:01.685632 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] Deleted volume successfully. Oct 22 21:04:01.717149 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-bc1873db-fd56-4aad-bb78-e4c04136f485 tempest-VolumesListTestJSON-366220154 None] Lock "cinder-b5b54cd2-5ca4-423c-92ff-1bd0563e126d-delete_volume" released by "delete_volume" :: held 0.975s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:04:05.257339 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=53,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:08.572109 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:04:08.635871 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Flow 'volume_create_manager' (c776aa3d-70ba-4c8f-b851-8b288f05c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:04:08.649959 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd25362f-fc07-4c0a-8ea6-5392c825dc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:08.738743 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd25362f-fc07-4c0a-8ea6-5392c825dc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-183971953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b72d589-816d-48d9-a6e1-870b1120a79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba7e19328594eae9e7d6a7c6e9c2147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:04:08Z,use_quota=True,user_id='89246f6315ac429c94630afb36be5253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:08.748962 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fa6c5b-3d61-4323-8227-bcfbb044ed74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:08.775157 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fa6c5b-3d61-4323-8227-bcfbb044ed74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:08.788474 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef4d824-0a29-40ca-a484-86fa9e102841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:08.796440 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef4d824-0a29-40ca-a484-86fa9e102841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b72d589-816d-48d9-a6e1-870b1120a79b', 'volume_name': 'volume-1b72d589-816d-48d9-a6e1-870b1120a79b', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:08.804634 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421dbdfc-e368-4718-a226-70b49c106a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:08.823998 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421dbdfc-e368-4718-a226-70b49c106a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:08.835178 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea0347f-ee8c-4c80-990d-0bb13a4a6bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:08.836598 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Volume 1b72d589-816d-48d9-a6e1-870b1120a79b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b72d589-816d-48d9-a6e1-870b1120a79b', 'volume_size': 1} Oct 22 21:04:08.837195 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] creating volume 'volume-1b72d589-816d-48d9-a6e1-870b1120a79b' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:04:08.839025 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:09.032734 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:04:09.033561 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:04:09.040413 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea0347f-ee8c-4c80-990d-0bb13a4a6bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b72d589-816d-48d9-a6e1-870b1120a79b', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:09.055250 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2bf8ac-6f1d-4106-9f4a-e15c0cff64fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:09.082761 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Volume volume-1b72d589-816d-48d9-a6e1-870b1120a79b (1b72d589-816d-48d9-a6e1-870b1120a79b): created successfully Oct 22 21:04:09.098410 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2bf8ac-6f1d-4106-9f4a-e15c0cff64fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:09.104685 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Flow 'volume_create_manager' (c776aa3d-70ba-4c8f-b851-8b288f05c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:04:09.150513 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9d54b69e-0ed1-41c0-b374-92a28ba995e7 tempest-VolumesNegativeTest-1146767104 None] Created volume successfully. Oct 22 21:04:19.127626 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=45,cinder:INSERT=10,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:30.514582 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:04:30.515257 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:30.603900 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:30.691680 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:04:43.620301 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:43.666565 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-43f32f0a-4005-439c-854e-daaf26b23e14 req-d676394d-b650-4fb0-b266-e8a568467902 tempest-TaggedBootDevicesTest_v242-1175888917 None] Terminate volume connection completed successfully. Oct 22 21:04:43.667435 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-43f32f0a-4005-439c-854e-daaf26b23e14 req-d676394d-b650-4fb0-b266-e8a568467902 tempest-TaggedBootDevicesTest_v242-1175888917 None] Deleting attachment 3ffc2079-00e7-435a-a1ad-ec49f69df002. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:04:43.961192 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-43f32f0a-4005-439c-854e-daaf26b23e14 req-2e6b9ee7-6b1b-46c1-b2dd-5bf118da6cbf tempest-TaggedBootDevicesTest_v242-1175888917 None] Terminate volume connection completed successfully. Oct 22 21:04:43.961606 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-43f32f0a-4005-439c-854e-daaf26b23e14 req-2e6b9ee7-6b1b-46c1-b2dd-5bf118da6cbf tempest-TaggedBootDevicesTest_v242-1175888917 None] Deleting attachment a32d070d-e8b7-4e77-809c-49b60a67efdf. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:04:44.242839 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-43f32f0a-4005-439c-854e-daaf26b23e14 req-603f7a87-3140-4297-b5b6-9b6ab1ae62ef tempest-TaggedBootDevicesTest_v242-1175888917 None] Terminate volume connection completed successfully. Oct 22 21:04:44.248919 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-43f32f0a-4005-439c-854e-daaf26b23e14 req-603f7a87-3140-4297-b5b6-9b6ab1ae62ef tempest-TaggedBootDevicesTest_v242-1175888917 None] Deleting attachment 315d9685-2ecc-4017-aeda-f529f4735d73. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:04:44.515694 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:04:44.622295 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (686e1bdd-ee82-4a2d-9f81-7b8d8ae2f3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:04:44.655185 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47b2ef0-65f6-475f-b814-691be4876a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:44.707763 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47b2ef0-65f6-475f-b814-691be4876a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1658454288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=737749a9-493b-4749-9f42-3bd0e28c14e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a42c3ecf474883ac652fcc8c01c9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:04:44Z,use_quota=True,user_id='7e3820b31a424c3a9216a6ef91fcb285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:44.726471 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09b29b9-b9be-4808-a684-67f47d79aced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:44.730931 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09b29b9-b9be-4808-a684-67f47d79aced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:44.735845 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf925f6a-1d84-4b3d-bb48-496d2087ccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:44.902787 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf925f6a-1d84-4b3d-bb48-496d2087ccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '737749a9-493b-4749-9f42-3bd0e28c14e9', 'volume_name': 'volume-737749a9-493b-4749-9f42-3bd0e28c14e9', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:44.921800 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da97584c-ec96-48b5-a401-aeb37653c9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:44.936285 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da97584c-ec96-48b5-a401-aeb37653c9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:44.962076 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e517d951-cb8f-4694-bf77-30cec4a4bafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:44.970056 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Volume 737749a9-493b-4749-9f42-3bd0e28c14e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-737749a9-493b-4749-9f42-3bd0e28c14e9', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 21:04:44.971051 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Cloning 737749a9-493b-4749-9f42-3bd0e28c14e9 from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 21:04:44.977426 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:04:45.006014 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.029s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:04:45.045803 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 4, 45, 31165)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:04:45.046251 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:04:45.046656 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 21:04:45.052623 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.047s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:04:45.053667 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 21:04:45.071807 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 4, 45, 59699)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:04:45.072549 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:04:45.072944 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 21:04:45.107258 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:45.231986 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] creating snapshot='volume-737749a9-493b-4749-9f42-3bd0e28c14e9.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:04:46.211257 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-737749a9-493b-4749-9f42-3bd0e28c14e9.clone_snap' to 'volume-737749a9-493b-4749-9f42-3bd0e28c14e9' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:04:46.513447 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:04:46.515031 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:04:46.515732 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:04:46.574594 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:04:46.575974 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Marking volume 737749a9-493b-4749-9f42-3bd0e28c14e9 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:04:46.592129 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to 737749a9-493b-4749-9f42-3bd0e28c14e9. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 21:04:46.592933 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Creating volume glance metadata for volume 737749a9-493b-4749-9f42-3bd0e28c14e9 backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 21:04:46.790430 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e517d951-cb8f-4694-bf77-30cec4a4bafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-737749a9-493b-4749-9f42-3bd0e28c14e9', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:46.806526 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14201f2c-8ae8-48b0-aa10-0e8f3cf4d718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:46.835888 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Volume volume-737749a9-493b-4749-9f42-3bd0e28c14e9 (737749a9-493b-4749-9f42-3bd0e28c14e9): created successfully Oct 22 21:04:46.841756 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14201f2c-8ae8-48b0-aa10-0e8f3cf4d718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:46.855699 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (686e1bdd-ee82-4a2d-9f81-7b8d8ae2f3bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:04:46.881180 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-94d5f8dc-cedf-4422-a9d2-af8184de9e1f tempest-TestVolumeBootPattern-1443368191 None] Created volume successfully. Oct 22 21:04:48.640108 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c4a226c7-2dcf-4aef-9130-065aba3ad552 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:49.431968 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c4a226c7-2dcf-4aef-9130-065aba3ad552 tempest-TestVolumeBootPattern-1443368191 None] Create snapshot completed successfully Oct 22 21:04:56.351149 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] Acquiring lock "cinder-1b72d589-816d-48d9-a6e1-870b1120a79b-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:04:56.387504 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] Lock "cinder-1b72d589-816d-48d9-a6e1-870b1120a79b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:04:56.539048 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:56.694219 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:04:56.695070 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] Volume volume-1b72d589-816d-48d9-a6e1-870b1120a79b is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:04:56.713377 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] deleting rbd volume volume-1b72d589-816d-48d9-a6e1-870b1120a79b {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:04:57.058020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:04:57.105620 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (6703b70a-f343-4386-80b4-73598f0aba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:04:57.119593 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb27960-c9af-4f2a-befc-ee8f40c32f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:57.142748 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb27960-c9af-4f2a-befc-ee8f40c32f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:04:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a42c3ecf474883ac652fcc8c01c9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f9a02f5e-9789-4559-a823-7403b3207f03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:04:57Z,use_quota=True,user_id='7e3820b31a424c3a9216a6ef91fcb285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:57.153591 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b918f2c-36f7-4a68-933f-f0544bbd93f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:57.159606 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b918f2c-36f7-4a68-933f-f0544bbd93f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:57.168580 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d113fb58-c435-4d5d-8fec-542c3412c8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:57.175128 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d113fb58-c435-4d5d-8fec-542c3412c8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d', 'volume_name': 'volume-0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d', 'volume_size': 1, 'snapshot_id': 'f9a02f5e-9789-4559-a823-7403b3207f03'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:57.183607 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce21213-6c4b-4b09-9252-19d20fdcd42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:57.189469 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce21213-6c4b-4b09-9252-19d20fdcd42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:57.195497 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9569dcd2-c2fa-43b3-8123-220fa2a22da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:57.198414 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Volume 0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d', 'volume_size': 1, 'snapshot_id': 'f9a02f5e-9789-4559-a823-7403b3207f03'} Oct 22 21:04:57.255981 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] cloning volumes/volume-737749a9-493b-4749-9f42-3bd0e28c14e9@snapshot-f9a02f5e-9789-4559-a823-7403b3207f03 to volume-0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d {{(pid=131630) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}} Oct 22 21:04:57.256966 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:57.467296 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:57.653132 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] Created reservations ['1a63996e-323a-409f-a020-6c3aa487e10e', 'fc3086bc-87c5-457f-9c3b-25365166be16', 'ab34d64d-cc96-4ba2-ada2-76e7e8604d54', '1694905a-19d9-4690-ac09-f7e21642ce92'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:04:57.798054 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:04:57.798427 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:04:57.808762 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:57.965491 ncdv-master-1 cinder-volume[131630]: WARNING cinder.volume.drivers.rbd [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Oct 22 21:04:57.990189 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:58.104720 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:58.193706 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:04:58.200235 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] Deleted volume successfully. Oct 22 21:04:58.204396 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Marking volume 0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:04:58.224306 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Copying metadata from snapshot f9a02f5e-9789-4559-a823-7403b3207f03 to 0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Oct 22 21:04:58.272957 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-eef7f046-100b-465c-80a3-3bc49d823043 tempest-VolumesNegativeTest-1146767104 None] Lock "cinder-1b72d589-816d-48d9-a6e1-870b1120a79b-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:04:58.306147 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] Acquiring lock "cinder-ebb1b567-e10c-480f-8fc1-0b24f1086d7e-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:04:58.337301 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9569dcd2-c2fa-43b3-8123-220fa2a22da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d', 'volume_size': 1, 'snapshot_id': 'f9a02f5e-9789-4559-a823-7403b3207f03'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:58.348023 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48fe35b-2612-42d1-90a4-24a442fd9b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:04:58.376633 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] Lock "cinder-ebb1b567-e10c-480f-8fc1-0b24f1086d7e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:04:58.392860 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Volume volume-0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d (0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d): created successfully Oct 22 21:04:58.398253 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48fe35b-2612-42d1-90a4-24a442fd9b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:04:58.425189 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (6703b70a-f343-4386-80b4-73598f0aba3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:04:58.456233 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-335da84d-e9fd-4108-8768-7b8a02baec0f tempest-TestVolumeBootPattern-1443368191 None] Created volume successfully. Oct 22 21:04:58.498356 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=58,cinder:UPDATE=16,cinder:INSERT=25,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:58.506527 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:58.612805 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:04:58.613270 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume volume-ebb1b567-e10c-480f-8fc1-0b24f1086d7e is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:04:58.627554 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] deleting rbd volume volume-ebb1b567-e10c-480f-8fc1-0b24f1086d7e {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:04:59.192408 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] Created reservations ['9982df0c-2c2b-477d-ae1e-a45d760b754e', '16a1164c-bda4-4e7d-ad2d-c50f5faf3d14', '09bf0e52-2252-42ae-b6c6-848934d4cc7d', '69f7d45d-72c1-4bcf-a951-46ec5168495c'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:04:59.209170 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=63,cinder:UPDATE=17,cinder:INSERT=17,cinder:DELETE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:04:59.355050 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:59.439810 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:59.519548 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:04:59.525560 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] Deleted volume successfully. Oct 22 21:04:59.568392 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] Acquiring lock "cinder-1b9bd5cf-91ea-49ac-9156-2270dc908725-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:04:59.575357 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-07746de7-3bef-45d4-b61c-651c13de18dc tempest-TaggedBootDevicesTest_v242-1175888917 None] Lock "cinder-ebb1b567-e10c-480f-8fc1-0b24f1086d7e-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:04:59.587283 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] Lock "cinder-1b9bd5cf-91ea-49ac-9156-2270dc908725-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:04:59.625994 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:04:59.723589 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:04:59.724342 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] Volume volume-1b9bd5cf-91ea-49ac-9156-2270dc908725 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:04:59.737734 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] deleting rbd volume volume-1b9bd5cf-91ea-49ac-9156-2270dc908725 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:05:00.305779 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] Created reservations ['cf29c33c-e29e-42ec-bc14-90d7cef48a5d', '76f99801-f9fa-4f2b-b518-07ad085a9f50', '4a98c2d0-0636-468f-8273-2a5206999c29', '534e8630-4b49-4074-9966-154810cb9cf0'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:05:00.395053 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:00.450895 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:00.525113 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:05:00.551620 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] Deleted volume successfully. Oct 22 21:05:00.583680 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9f9786f6-21ab-4cae-b145-5cea889c6520 tempest-TaggedBootDevicesTest_v242-1175888917 None] Lock "cinder-1b9bd5cf-91ea-49ac-9156-2270dc908725-delete_volume" released by "delete_volume" :: held 0.997s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:05:00.739234 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-631370bd-8bd3-43bb-abe5-111686aed34f tempest-TestVolumeBootPattern-1443368191 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:05:00.877689 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] Acquiring lock "cinder-d1d5f32b-f8b3-4714-96ae-203dc0482f4b-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:05:00.909898 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] Lock "cinder-d1d5f32b-f8b3-4714-96ae-203dc0482f4b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:05:01.027490 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:01.146279 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:05:01.165383 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] deleting rbd volume volume-d1d5f32b-f8b3-4714-96ae-203dc0482f4b {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:05:01.896962 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:05:01.954196 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] deleting parent snapshot volume-d1d5f32b-f8b3-4714-96ae-203dc0482f4b.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:05:02.969884 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-631370bd-8bd3-43bb-abe5-111686aed34f tempest-TestVolumeBootPattern-1443368191 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.232s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:05:02.972232 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-631370bd-8bd3-43bb-abe5-111686aed34f tempest-TestVolumeBootPattern-1443368191 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:05:03.068147 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-631370bd-8bd3-43bb-abe5-111686aed34f tempest-TestVolumeBootPattern-1443368191 None] Connection info returned from driver {'name': 'volumes/volume-0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5cf8ea08-5a82-464b-a108-558ef13fcc1c'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:05:03.138811 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] Created reservations ['a8e942ae-c792-4eff-83f5-a40d0a66b5fd', 'af8f6d32-a94f-46b6-804f-2803c3b47a21', 'cb04edfa-55a1-41f8-874f-7af49bba5dff', '5b5e5c01-5f0d-4bc5-8d32-de37f84e85ce'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:05:03.201815 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-595fbc69-ea5e-4fd9-883a-88c0edfbb6db req-631370bd-8bd3-43bb-abe5-111686aed34f tempest-TestVolumeBootPattern-1443368191 None] attachment_update completed successfully. Oct 22 21:05:03.267991 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:03.370089 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:03.473402 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:05:03.491530 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] Deleted volume successfully. Oct 22 21:05:03.515923 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c42e6822-626a-4d84-9198-cbd3b64033a5 tempest-TaggedBootDevicesTest_v242-1175888917 None] Lock "cinder-d1d5f32b-f8b3-4714-96ae-203dc0482f4b-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:05:06.858522 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:05:06.932546 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (98985e70-e85b-49b2-88a2-31c3fbe24b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:05:06.954807 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7eceeb-beb8-4737-bede-100a29a331c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:07.001015 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7eceeb-beb8-4737-bede-100a29a331c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-397722478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b9959707-0ed2-44c8-9e98-fa250b2609b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21349e14fb39496c9996d5af817b7f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:05:07Z,use_quota=True,user_id='7102f7b674934e19b3d4a001b563d0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:07.010944 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b31fb1-87c9-447c-a733-bd7a881c6a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:07.016799 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b31fb1-87c9-447c-a733-bd7a881c6a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:07.024739 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ca2544-9104-4a3d-b884-1affb73ae941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:07.029981 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ca2544-9104-4a3d-b884-1affb73ae941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9959707-0ed2-44c8-9e98-fa250b2609b9', 'volume_name': 'volume-b9959707-0ed2-44c8-9e98-fa250b2609b9', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:07.045777 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec7bbe6-ea73-4de2-9a6c-4d6189642837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:07.056297 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec7bbe6-ea73-4de2-9a6c-4d6189642837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:07.068690 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f64cad-e3f0-483f-ab92-0ac015f3210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:07.073614 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume b9959707-0ed2-44c8-9e98-fa250b2609b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9959707-0ed2-44c8-9e98-fa250b2609b9', 'volume_size': 1} Oct 22 21:05:07.074028 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] creating volume 'volume-b9959707-0ed2-44c8-9e98-fa250b2609b9' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:05:07.078881 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:07.246416 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:05:07.247051 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:05:07.250615 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f64cad-e3f0-483f-ab92-0ac015f3210d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9959707-0ed2-44c8-9e98-fa250b2609b9', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:07.263629 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733dff11-746b-4a06-b6ec-6d3fe9359b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:07.285173 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume volume-b9959707-0ed2-44c8-9e98-fa250b2609b9 (b9959707-0ed2-44c8-9e98-fa250b2609b9): created successfully Oct 22 21:05:07.290060 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733dff11-746b-4a06-b6ec-6d3fe9359b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:07.301279 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (98985e70-e85b-49b2-88a2-31c3fbe24b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:05:07.324683 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d4419bfc-56ce-42f6-ad45-d90addef46e8 tempest-VolumesSnapshotTestJSON-1543447304 None] Created volume successfully. Oct 22 21:05:08.466973 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f09c96f6-7467-41f5-b50b-1c4c9852fcc8 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:09.166840 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f09c96f6-7467-41f5-b50b-1c4c9852fcc8 tempest-VolumesSnapshotTestJSON-1543447304 None] Create snapshot completed successfully Oct 22 21:05:10.086366 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.driver [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] Creating a new backup for volume volume-b9959707-0ed2-44c8-9e98-fa250b2609b9. {{(pid=131630) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1218}} Oct 22 21:05:10.181867 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] cloning volumes/volume-b9959707-0ed2-44c8-9e98-fa250b2609b9@snapshot-397b6243-0159-4149-9401-bc1746c00726 to volume-9b892fa6-2a0a-4c53-a29e-426e7f83b209 {{(pid=131630) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}} Oct 22 21:05:10.183622 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:10.335363 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:10.639368 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:05:10.639770 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:05:10.680080 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-22T21:05:09Z,data_timestamp=2022-10-22T21:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1172350094',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=d7abb97e-43f7-41a7-8c33-414d0625425f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='21349e14fb39496c9996d5af817b7f73',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='397b6243-0159-4149-9401-bc1746c00726',status='creating',temp_snapshot_id=None,temp_volume_id='9b892fa6-2a0a-4c53-a29e-426e7f83b209',updated_at=None,user_id='7102f7b674934e19b3d4a001b563d0d5',volume_id=b9959707-0ed2-44c8-9e98-fa250b2609b9) Oct 22 21:05:10.681331 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.backup.rpcapi [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] continue_backup in rpcapi backup_id d7abb97e-43f7-41a7-8c33-414d0625425f {{(pid=131630) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Oct 22 21:05:11.025765 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:05:12.648413 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.622s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:05:12.649670 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9b892fa6-2a0a-4c53-a29e-426e7f83b209', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '9b892fa6-2a0a-4c53-a29e-426e7f83b209', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:05:12.682449 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] Initialize volume connection completed successfully. Oct 22 21:05:16.246502 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=61,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:30.513502 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:05:30.515132 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:30.614758 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:30.693491 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:05:31.378043 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=59,cinder:INSERT=7,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:31.407292 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] Terminate volume connection completed successfully. Oct 22 21:05:31.509354 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] Remove volume export completed successfully. Oct 22 21:05:31.543769 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-9b892fa6-2a0a-4c53-a29e-426e7f83b209-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:05:31.556254 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-9b892fa6-2a0a-4c53-a29e-426e7f83b209-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:05:31.582135 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:31.702027 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:05:31.713867 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] deleting rbd volume volume-9b892fa6-2a0a-4c53-a29e-426e7f83b209 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:05:32.241197 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] Deleted volume successfully. Oct 22 21:05:32.249054 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-69106cb5-3b54-43a2-8a3c-313eac673eb1 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-9b892fa6-2a0a-4c53-a29e-426e7f83b209-delete_volume" released by "delete_volume" :: held 0.693s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:05:33.305367 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-89b1a746-9dab-458b-bac7-49512924504e req-19f57361-bb6c-44f4-abe9-5eb84e19555b tempest-TestVolumeBootPattern-1443368191 None] Terminate volume connection completed successfully. Oct 22 21:05:33.309098 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-89b1a746-9dab-458b-bac7-49512924504e req-19f57361-bb6c-44f4-abe9-5eb84e19555b tempest-TestVolumeBootPattern-1443368191 None] Deleting attachment 5cf8ea08-5a82-464b-a108-558ef13fcc1c. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:05:33.688953 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-89b1a746-9dab-458b-bac7-49512924504e req-ed2c5099-31fa-4f36-80e5-0fbfac134a42 tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:05:33.719454 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-89b1a746-9dab-458b-bac7-49512924504e req-ed2c5099-31fa-4f36-80e5-0fbfac134a42 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:05:33.835686 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-89b1a746-9dab-458b-bac7-49512924504e req-ed2c5099-31fa-4f36-80e5-0fbfac134a42 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:34.014131 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-89b1a746-9dab-458b-bac7-49512924504e req-ed2c5099-31fa-4f36-80e5-0fbfac134a42 tempest-TestVolumeBootPattern-1443368191 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:05:34.043787 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-89b1a746-9dab-458b-bac7-49512924504e req-ed2c5099-31fa-4f36-80e5-0fbfac134a42 tempest-TestVolumeBootPattern-1443368191 None] deleting rbd volume volume-0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:05:34.612205 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [req-89b1a746-9dab-458b-bac7-49512924504e req-ed2c5099-31fa-4f36-80e5-0fbfac134a42 tempest-TestVolumeBootPattern-1443368191 None] Created reservations ['462a4a51-5dc5-48c9-80fa-a42b169028db', 'd93aac00-8598-4400-b635-e748948a1806', '939de06b-da80-4ff5-afa5-36d8aeef7010', '3aed6867-7a92-424e-a418-51255cb48eb8'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:05:34.742223 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-89b1a746-9dab-458b-bac7-49512924504e req-ed2c5099-31fa-4f36-80e5-0fbfac134a42 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:34.825020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-89b1a746-9dab-458b-bac7-49512924504e req-ed2c5099-31fa-4f36-80e5-0fbfac134a42 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:34.915940 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [req-89b1a746-9dab-458b-bac7-49512924504e req-ed2c5099-31fa-4f36-80e5-0fbfac134a42 tempest-TestVolumeBootPattern-1443368191 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:05:34.922441 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-89b1a746-9dab-458b-bac7-49512924504e req-ed2c5099-31fa-4f36-80e5-0fbfac134a42 tempest-TestVolumeBootPattern-1443368191 None] Deleted volume successfully. Oct 22 21:05:34.949751 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-89b1a746-9dab-458b-bac7-49512924504e req-ed2c5099-31fa-4f36-80e5-0fbfac134a42 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-0bb0ab2c-7ab3-43c5-a693-15c1cab17e1d-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:05:37.616261 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-1ab67e48-83fa-472a-9300-251b013ef490 tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-f9a02f5e-9789-4559-a823-7403b3207f03-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:05:37.651550 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-1ab67e48-83fa-472a-9300-251b013ef490 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-f9a02f5e-9789-4559-a823-7403b3207f03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:05:37.659281 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1ab67e48-83fa-472a-9300-251b013ef490 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:38.183287 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-1ab67e48-83fa-472a-9300-251b013ef490 tempest-TestVolumeBootPattern-1443368191 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:05:38.204207 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-1ab67e48-83fa-472a-9300-251b013ef490 tempest-TestVolumeBootPattern-1443368191 None] Created reservations ['99c1989f-0c61-4b1d-915e-b8e3b8d6af79', '8b2a17e6-0ef7-4b03-8b2b-000443799b56', '2deda7a3-2bcd-4aa4-969f-b1841c9c5624', '8e4047eb-d6eb-49d6-ae23-fe4633f99913'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:05:38.268217 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-1ab67e48-83fa-472a-9300-251b013ef490 tempest-TestVolumeBootPattern-1443368191 None] Delete snapshot completed successfully. Oct 22 21:05:38.276230 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-1ab67e48-83fa-472a-9300-251b013ef490 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-f9a02f5e-9789-4559-a823-7403b3207f03-delete_snapshot" released by "delete_snapshot" :: held 0.631s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:05:38.799584 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-737749a9-493b-4749-9f42-3bd0e28c14e9-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:05:38.814149 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-737749a9-493b-4749-9f42-3bd0e28c14e9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:05:38.890380 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:39.038682 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:05:39.057276 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] deleting rbd volume volume-737749a9-493b-4749-9f42-3bd0e28c14e9 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:05:39.534563 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:05:39.586762 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] deleting parent snapshot volume-737749a9-493b-4749-9f42-3bd0e28c14e9.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:05:40.294328 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] Created reservations ['d5d91acd-8512-49dd-ab37-072e2dc63581', 'f4946813-dbed-4189-8cde-343a247030a7', '83c97973-dfe3-4598-87e1-839a9462f202', '6fddcf35-6648-4a7a-8468-53edc6b82389'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:05:40.433245 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:40.496499 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:40.564796 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:05:40.571379 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] Deleted volume successfully. Oct 22 21:05:40.592400 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-63767561-21e8-44b9-a071-cdc6ffbddc68 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-737749a9-493b-4749-9f42-3bd0e28c14e9-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:05:42.205449 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:05:42.232507 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (2ebaffee-4e74-4cf9-9911-22de7a240d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:05:42.241005 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b8c10c-c346-44c9-90f7-a3b4c361b418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:42.263425 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b8c10c-c346-44c9-90f7-a3b4c361b418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-549935567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=12b295a8-421c-425d-b63f-f8315c51d5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a42c3ecf474883ac652fcc8c01c9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:05:42Z,use_quota=True,user_id='7e3820b31a424c3a9216a6ef91fcb285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:42.272870 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6937c415-3230-409b-b729-ea7a94c3d5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:42.280492 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6937c415-3230-409b-b729-ea7a94c3d5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:42.288212 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a6673a-d0d7-46ba-89db-64ab38387452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:42.468780 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a6673a-d0d7-46ba-89db-64ab38387452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '12b295a8-421c-425d-b63f-f8315c51d5e6', 'volume_name': 'volume-12b295a8-421c-425d-b63f-f8315c51d5e6', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:42.484718 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fdc056-3ff9-43a5-8aca-f035ab57bd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:42.498460 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fdc056-3ff9-43a5-8aca-f035ab57bd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:42.511967 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d823e739-8477-4e39-b7e1-4601941225c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:42.513633 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Volume 12b295a8-421c-425d-b63f-f8315c51d5e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-12b295a8-421c-425d-b63f-f8315c51d5e6', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 21:05:42.514398 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Cloning 12b295a8-421c-425d-b63f-f8315c51d5e6 from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 21:05:42.515393 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:05:42.542442 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.027s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:05:42.574850 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 5, 42, 554556)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:05:42.576142 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:05:42.577251 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 21:05:42.587299 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.045s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:05:42.588613 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 21:05:42.605449 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 5, 42, 602228)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:05:42.606414 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:05:42.607227 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 21:05:42.634501 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:05:42.757819 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] creating snapshot='volume-12b295a8-421c-425d-b63f-f8315c51d5e6.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:05:43.308163 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-12b295a8-421c-425d-b63f-f8315c51d5e6.clone_snap' to 'volume-12b295a8-421c-425d-b63f-f8315c51d5e6' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:05:43.679219 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:05:43.682167 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:05:43.683486 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:05:43.753751 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:05:43.754598 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Marking volume 12b295a8-421c-425d-b63f-f8315c51d5e6 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:05:43.768537 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to 12b295a8-421c-425d-b63f-f8315c51d5e6. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 21:05:43.786333 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Creating volume glance metadata for volume 12b295a8-421c-425d-b63f-f8315c51d5e6 backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 21:05:44.000947 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d823e739-8477-4e39-b7e1-4601941225c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b295a8-421c-425d-b63f-f8315c51d5e6', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:44.025508 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db48fcbb-68fc-4cc3-a90b-5dfce30479d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:05:44.053833 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Volume volume-12b295a8-421c-425d-b63f-f8315c51d5e6 (12b295a8-421c-425d-b63f-f8315c51d5e6): created successfully Oct 22 21:05:44.074090 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db48fcbb-68fc-4cc3-a90b-5dfce30479d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:05:44.092526 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (2ebaffee-4e74-4cf9-9911-22de7a240d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:05:44.118841 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-369e4413-4d6e-481f-bd71-aaf6932345de tempest-TestVolumeBootPattern-1443368191 None] Created volume successfully. Oct 22 21:05:46.234211 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=52,cinder:UPDATE=29,cinder:INSERT=17,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:50.516463 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=62,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:05:50.534194 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-9257b5fe-bf2a-43ec-adde-58879507d5dd req-b7c10644-17ee-4422-abf9-12d0fd08ab86 tempest-TestVolumeBootPattern-1443368191 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:05:52.421031 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-9257b5fe-bf2a-43ec-adde-58879507d5dd req-b7c10644-17ee-4422-abf9-12d0fd08ab86 tempest-TestVolumeBootPattern-1443368191 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.887s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:05:52.422879 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-9257b5fe-bf2a-43ec-adde-58879507d5dd req-b7c10644-17ee-4422-abf9-12d0fd08ab86 tempest-TestVolumeBootPattern-1443368191 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-12b295a8-421c-425d-b63f-f8315c51d5e6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '12b295a8-421c-425d-b63f-f8315c51d5e6', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:05:52.467056 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-9257b5fe-bf2a-43ec-adde-58879507d5dd req-b7c10644-17ee-4422-abf9-12d0fd08ab86 tempest-TestVolumeBootPattern-1443368191 None] Connection info returned from driver {'name': 'volumes/volume-12b295a8-421c-425d-b63f-f8315c51d5e6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '12b295a8-421c-425d-b63f-f8315c51d5e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '04ad2541-e9d3-4cee-9961-6076066c9ce2'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:05:52.641508 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-9257b5fe-bf2a-43ec-adde-58879507d5dd req-b7c10644-17ee-4422-abf9-12d0fd08ab86 tempest-TestVolumeBootPattern-1443368191 None] attachment_update completed successfully. Oct 22 21:06:04.823949 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:06:04.844931 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (0ce7a1d9-4a7a-42a5-9798-ce64aeeeaeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:06:04.851746 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b869ba-e790-4c8a-8284-42f68daa6985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:04.879666 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b869ba-e790-4c8a-8284-42f68daa6985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1981218707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21349e14fb39496c9996d5af817b7f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:06:05Z,use_quota=True,user_id='7102f7b674934e19b3d4a001b563d0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:04.885860 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e87fce-a502-447e-b809-241d80dfb0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:04.890806 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e87fce-a502-447e-b809-241d80dfb0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:04.895873 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8e08b3-a7e6-435c-b1ca-31f1d234cd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:05.002830 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8e08b3-a7e6-435c-b1ca-31f1d234cd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8', 'volume_name': 'volume-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:05.007939 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005647b3-9dd8-404e-9ed3-d26195d7b62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:05.011819 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005647b3-9dd8-404e-9ed3-d26195d7b62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:05.016234 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8584da6e-27c6-48fe-952b-58bfd99e831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:05.017345 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Volume 6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 21:06:05.017987 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Cloning 6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8 from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 21:06:05.018706 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:06:05.030278 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:06:05.044965 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 6, 5, 37518)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:06:05.045635 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:06:05.046125 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 21:06:05.052199 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:06:05.053049 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 21:06:05.060109 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 6, 5, 57547)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:06:05.060656 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:06:05.061585 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 21:06:05.073384 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:05.140873 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] creating snapshot='volume-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:06:06.107352 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8.clone_snap' to 'volume-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:06:06.304688 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:06:06.306648 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:06:06.307258 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:06:06.346138 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:06:06.346991 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Marking volume 6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:06:06.369913 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to 6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 21:06:06.383771 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Creating volume glance metadata for volume 6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8 backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 21:06:06.509240 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8584da6e-27c6-48fe-952b-58bfd99e831f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:06.515362 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47f77da-1daf-4e54-a990-a0746643a2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:06.526304 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Volume volume-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8 (6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8): created successfully Oct 22 21:06:06.531132 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47f77da-1daf-4e54-a990-a0746643a2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:06.542126 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (0ce7a1d9-4a7a-42a5-9798-ce64aeeeaeea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:06:06.555057 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-784c3e3b-0f4d-4e3a-ad11-bd7ccfec2cef tempest-VolumesSnapshotTestJSON-1543447304 None] Created volume successfully. Oct 22 21:06:07.718695 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 req-d200e855-d19a-4ef0-b2f2-a17d482ff32d tempest-VolumesSnapshotTestJSON-1543447304 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:06:08.552331 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 req-d200e855-d19a-4ef0-b2f2-a17d482ff32d tempest-VolumesSnapshotTestJSON-1543447304 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.833s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:06:08.553183 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 req-d200e855-d19a-4ef0-b2f2-a17d482ff32d tempest-VolumesSnapshotTestJSON-1543447304 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:06:08.586165 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 req-d200e855-d19a-4ef0-b2f2-a17d482ff32d tempest-VolumesSnapshotTestJSON-1543447304 None] Connection info returned from driver {'name': 'volumes/volume-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '31f49fe2-deb2-40c3-887d-818661b5a97b'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:06:08.653102 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-98f2a362-de93-437a-a4dd-e7e6db5d5e43 req-d200e855-d19a-4ef0-b2f2-a17d482ff32d tempest-VolumesSnapshotTestJSON-1543447304 None] attachment_update completed successfully. Oct 22 21:06:10.918881 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-3104e477-1385-48ad-be79-967af7ffb96f req-9829f6fd-f174-4691-a38e-cb1687bbb3e4 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:11.131825 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e2700479-b2ec-428e-88c0-4d59a0e96c0a tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:12.472897 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e2700479-b2ec-428e-88c0-4d59a0e96c0a tempest-VolumesSnapshotTestJSON-1543447304 None] Create snapshot completed successfully Oct 22 21:06:12.479079 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-3104e477-1385-48ad-be79-967af7ffb96f req-9829f6fd-f174-4691-a38e-cb1687bbb3e4 tempest-TestVolumeBootPattern-1443368191 None] Create snapshot completed successfully Oct 22 21:06:13.386779 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-01adf00b-752f-4862-abee-978d2fb8c3c3 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:14.336912 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-01adf00b-752f-4862-abee-978d2fb8c3c3 tempest-VolumesSnapshotTestJSON-1543447304 None] Create snapshot completed successfully Oct 22 21:06:14.664657 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=60,cinder:UPDATE=14,cinder:INSERT=23,cinder:DELETE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:14.681546 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=68,cinder:UPDATE=6,cinder:INSERT=25,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:14.715739 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e38c1825-7bb9-428d-b71f-5f9b289f87f3 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:15.336360 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e38c1825-7bb9-428d-b71f-5f9b289f87f3 tempest-VolumesSnapshotTestJSON-1543447304 None] Create snapshot completed successfully Oct 22 21:06:15.810964 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-17b682d5-838c-46bc-8b3e-2bdfae34eeed tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-edb3975f-e90b-4bdc-b8f9-307d6c642f25-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:06:15.848928 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-17b682d5-838c-46bc-8b3e-2bdfae34eeed tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-edb3975f-e90b-4bdc-b8f9-307d6c642f25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:06:15.849730 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-17b682d5-838c-46bc-8b3e-2bdfae34eeed tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:16.274745 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:06:16.322102 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (77daf8b4-a5da-4749-8a0d-8b4feea8f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:06:16.324507 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa91671e-1009-4ecb-86e5-151dafd56661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:16.342024 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa91671e-1009-4ecb-86e5-151dafd56661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:06:16Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=53580b19-69c8-49b3-abff-e9e70545e86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a42c3ecf474883ac652fcc8c01c9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0486457a-c86d-44d6-b9f8-ec655e378924,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:06:16Z,use_quota=True,user_id='7e3820b31a424c3a9216a6ef91fcb285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:16.347882 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887d86fe-acd7-48e9-b40b-177ca161eeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:16.352676 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887d86fe-acd7-48e9-b40b-177ca161eeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:16.357531 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a44dc9-4ef6-435b-844a-2450a61d6727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:16.364394 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a44dc9-4ef6-435b-844a-2450a61d6727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '53580b19-69c8-49b3-abff-e9e70545e86c', 'volume_name': 'volume-53580b19-69c8-49b3-abff-e9e70545e86c', 'volume_size': 1, 'snapshot_id': '0486457a-c86d-44d6-b9f8-ec655e378924'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:16.366471 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a478a24-38c9-4f8c-ac72-c05c0cb2fd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:16.370264 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a478a24-38c9-4f8c-ac72-c05c0cb2fd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:16.374756 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e1a6f5-008d-4e74-939e-c75c1675b320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:16.376107 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Volume 53580b19-69c8-49b3-abff-e9e70545e86c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-53580b19-69c8-49b3-abff-e9e70545e86c', 'volume_size': 1, 'snapshot_id': '0486457a-c86d-44d6-b9f8-ec655e378924'} Oct 22 21:06:16.404645 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] cloning volumes/volume-12b295a8-421c-425d-b63f-f8315c51d5e6@snapshot-0486457a-c86d-44d6-b9f8-ec655e378924 to volume-53580b19-69c8-49b3-abff-e9e70545e86c {{(pid=131630) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}} Oct 22 21:06:16.405615 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:16.477992 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:16.672187 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:06:16.672578 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:06:16.709007 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Marking volume 53580b19-69c8-49b3-abff-e9e70545e86c as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:06:16.718043 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Copying metadata from snapshot 0486457a-c86d-44d6-b9f8-ec655e378924 to 53580b19-69c8-49b3-abff-e9e70545e86c. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Oct 22 21:06:16.760596 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e1a6f5-008d-4e74-939e-c75c1675b320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53580b19-69c8-49b3-abff-e9e70545e86c', 'volume_size': 1, 'snapshot_id': '0486457a-c86d-44d6-b9f8-ec655e378924'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:16.765008 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee363fb1-f2fa-454c-996c-0b2e1322beb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:06:16.775814 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Volume volume-53580b19-69c8-49b3-abff-e9e70545e86c (53580b19-69c8-49b3-abff-e9e70545e86c): created successfully Oct 22 21:06:16.780344 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee363fb1-f2fa-454c-996c-0b2e1322beb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:06:16.785812 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (77daf8b4-a5da-4749-8a0d-8b4feea8f07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:06:16.801128 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-fdf55127-1680-4295-8b98-3afb6c8093c6 tempest-TestVolumeBootPattern-1443368191 None] Created volume successfully. Oct 22 21:06:17.052601 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] Acquiring lock "cinder-5d2013d8-0420-4b76-9785-fd5fa05ccf6e-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:06:17.069482 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] Lock "cinder-5d2013d8-0420-4b76-9785-fd5fa05ccf6e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:06:17.129955 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:17.222715 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:06:17.223478 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] Volume volume-5d2013d8-0420-4b76-9785-fd5fa05ccf6e is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:06:17.243425 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] deleting rbd volume volume-5d2013d8-0420-4b76-9785-fd5fa05ccf6e {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:06:17.714066 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] Created reservations ['ec727c02-03cc-4b78-a252-80f0334f02e6', '0231204b-2d98-4829-aa2c-4419d403c414', 'b8ca61ec-d145-4b3f-8d1c-f54ead95516d', 'e61e8b04-7565-42e4-929c-43a7ed88ffad'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:06:17.791914 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:17.841081 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:17.889838 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:06:17.895398 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] Deleted volume successfully. Oct 22 21:06:17.917301 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d6a1000a-8168-4a8b-ab89-0738aaf8405e tempest-DeleteServersTestJSON-1244431593 None] Lock "cinder-5d2013d8-0420-4b76-9785-fd5fa05ccf6e-delete_volume" released by "delete_volume" :: held 0.848s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:06:19.894194 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-a721da26-4934-4f41-961a-a389d8f7e727 tempest-TestVolumeBootPattern-1443368191 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:06:20.997779 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-a721da26-4934-4f41-961a-a389d8f7e727 tempest-TestVolumeBootPattern-1443368191 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.102s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:06:21.000344 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-a721da26-4934-4f41-961a-a389d8f7e727 tempest-TestVolumeBootPattern-1443368191 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-53580b19-69c8-49b3-abff-e9e70545e86c', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '53580b19-69c8-49b3-abff-e9e70545e86c', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:06:21.035752 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-a721da26-4934-4f41-961a-a389d8f7e727 tempest-TestVolumeBootPattern-1443368191 None] Connection info returned from driver {'name': 'volumes/volume-53580b19-69c8-49b3-abff-e9e70545e86c', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '53580b19-69c8-49b3-abff-e9e70545e86c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'afea92ff-0fcf-4967-8c4d-3ed24c32669e'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:06:21.129142 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-aa20c0ec-21a1-4963-a7ee-1158cc02b78a req-a721da26-4934-4f41-961a-a389d8f7e727 tempest-TestVolumeBootPattern-1443368191 None] attachment_update completed successfully. Oct 22 21:06:30.510352 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:06:30.511240 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:30.542760 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:30.573889 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:06:37.739832 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-580bb44d-dc26-4b5d-8071-7e52922713b5 tempest-TestVolumeBootPattern-1443368191 None] Terminate volume connection completed successfully. Oct 22 21:06:37.740507 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-580bb44d-dc26-4b5d-8071-7e52922713b5 tempest-TestVolumeBootPattern-1443368191 None] Deleting attachment afea92ff-0fcf-4967-8c4d-3ed24c32669e. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:06:38.013619 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-ed79441e-8630-4b50-b92d-ec0f4095d406 tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-53580b19-69c8-49b3-abff-e9e70545e86c-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:06:38.030873 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-ed79441e-8630-4b50-b92d-ec0f4095d406 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-53580b19-69c8-49b3-abff-e9e70545e86c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:06:38.101971 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-ed79441e-8630-4b50-b92d-ec0f4095d406 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:38.290649 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-ed79441e-8630-4b50-b92d-ec0f4095d406 tempest-TestVolumeBootPattern-1443368191 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:06:38.311519 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-ed79441e-8630-4b50-b92d-ec0f4095d406 tempest-TestVolumeBootPattern-1443368191 None] deleting rbd volume volume-53580b19-69c8-49b3-abff-e9e70545e86c {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:06:39.318481 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-ed79441e-8630-4b50-b92d-ec0f4095d406 tempest-TestVolumeBootPattern-1443368191 None] Created reservations ['7dd70176-2178-4816-9952-07a0721fddb6', '7ef76c86-8cff-4a5c-b396-b5b53628c143', 'a7fb7b53-a5ca-49e0-8742-7271624ea0ef', '0d553927-0e45-498e-8064-e80c2accbe31'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:06:39.452478 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=64,cinder:INSERT=17,cinder:UPDATE=19 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:39.488612 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-ed79441e-8630-4b50-b92d-ec0f4095d406 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:39.591391 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-ed79441e-8630-4b50-b92d-ec0f4095d406 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:39.689916 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-ed79441e-8630-4b50-b92d-ec0f4095d406 tempest-TestVolumeBootPattern-1443368191 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:06:39.705652 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-ed79441e-8630-4b50-b92d-ec0f4095d406 tempest-TestVolumeBootPattern-1443368191 None] Deleted volume successfully. Oct 22 21:06:39.752551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-925381c9-5be2-4815-9536-5a6cc3521c83 req-ed79441e-8630-4b50-b92d-ec0f4095d406 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-53580b19-69c8-49b3-abff-e9e70545e86c-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:06:39.865172 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7f173333-6e1c-4006-b5df-7f4567e0dcd7 tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-0486457a-c86d-44d6-b9f8-ec655e378924-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:06:39.903270 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7f173333-6e1c-4006-b5df-7f4567e0dcd7 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-0486457a-c86d-44d6-b9f8-ec655e378924-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:06:39.906372 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7f173333-6e1c-4006-b5df-7f4567e0dcd7 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:46.060035 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=25,cinder:SELECT=55,cinder:INSERT=15,cinder:DELETE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:06:46.106643 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-17b682d5-838c-46bc-8b3e-2bdfae34eeed tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['c3ca409c-8ac4-411b-b7ee-e227ddc7cddf', '478738a2-4fd0-41be-82eb-e8b56609a6e2', '2801b182-fc68-40f7-8075-12e46e998bcd', 'a46f49c4-35ed-445e-b201-ee5cd5ea9fe0'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:06:46.263174 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-17b682d5-838c-46bc-8b3e-2bdfae34eeed tempest-VolumesSnapshotTestJSON-1543447304 None] Delete snapshot completed successfully. Oct 22 21:06:46.273830 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-17b682d5-838c-46bc-8b3e-2bdfae34eeed tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-edb3975f-e90b-4bdc-b8f9-307d6c642f25-delete_snapshot" released by "delete_snapshot" :: held 30.428s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:06:46.627644 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-49290790-798d-42c1-975c-e31dc15259b1 tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-160d5750-c11d-4513-bc48-b66a8a815a9f-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:06:46.641468 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-49290790-798d-42c1-975c-e31dc15259b1 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-160d5750-c11d-4513-bc48-b66a8a815a9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:06:46.650739 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-49290790-798d-42c1-975c-e31dc15259b1 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:06:56.253730 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:06.233490 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=19,cinder:INSERT=4,cinder:UPDATE=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:10.339540 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-7f173333-6e1c-4006-b5df-7f4567e0dcd7 tempest-TestVolumeBootPattern-1443368191 None] Created reservations ['ea22a6cd-4c71-414a-9266-2bf275557e53', '29c6aedd-e9c1-42d4-971b-2e8c07385357', '9f4ed161-cd57-4a66-bc8b-0eec7de8f050', '13085a05-8536-44e5-a6fd-0b900b264919'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:07:10.413888 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7f173333-6e1c-4006-b5df-7f4567e0dcd7 tempest-TestVolumeBootPattern-1443368191 None] Delete snapshot completed successfully. Oct 22 21:07:10.429141 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7f173333-6e1c-4006-b5df-7f4567e0dcd7 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-0486457a-c86d-44d6-b9f8-ec655e378924-delete_snapshot" released by "delete_snapshot" :: held 30.526s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:07:14.630535 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-7be3a646-b3d2-4561-ac3d-ebcc5644e88d tempest-TestVolumeBootPattern-1443368191 None] Terminate volume connection completed successfully. Oct 22 21:07:14.631685 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-7be3a646-b3d2-4561-ac3d-ebcc5644e88d tempest-TestVolumeBootPattern-1443368191 None] Deleting attachment 04ad2541-e9d3-4cee-9961-6076066c9ce2. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:07:14.993414 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-12b295a8-421c-425d-b63f-f8315c51d5e6-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:07:15.004902 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-12b295a8-421c-425d-b63f-f8315c51d5e6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:07:15.099724 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:07:15.253244 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:07:15.266986 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] deleting rbd volume volume-12b295a8-421c-425d-b63f-f8315c51d5e6 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:07:15.611666 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:07:15.648722 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] deleting parent snapshot volume-12b295a8-421c-425d-b63f-f8315c51d5e6.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:07:16.751649 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] Created reservations ['961e704a-c70c-4e21-b1f2-4fdb7ad0999d', '267d45f9-dc95-4845-bd10-7ab25a1cf749', '175f6c8f-579a-4f95-8130-b961c6b0ed6a', 'f6d4c1f5-44e3-4e76-9ae2-c371f6fd9f82'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:07:16.836510 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:07:16.903490 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:07:16.980611 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:07:17.015901 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] Deleted volume successfully. Oct 22 21:07:17.060228 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-d2732404-f8d8-4875-b0e9-0fa164be331f req-88390b85-4485-41d4-a030-ceec3eeec479 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-12b295a8-421c-425d-b63f-f8315c51d5e6-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:07:17.116530 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-49290790-798d-42c1-975c-e31dc15259b1 tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['8d1f41b6-b288-4e79-87d0-0aff99b8543d', '92f8bd02-8102-455c-8614-159e5b3c11e5', '6681d962-4746-4dcc-801d-2ad90bcc908d', '3a50d16f-34d8-4405-adad-7d1e583a8376'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:07:17.245407 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-49290790-798d-42c1-975c-e31dc15259b1 tempest-VolumesSnapshotTestJSON-1543447304 None] Delete snapshot completed successfully. Oct 22 21:07:17.253199 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-49290790-798d-42c1-975c-e31dc15259b1 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-160d5750-c11d-4513-bc48-b66a8a815a9f-delete_snapshot" released by "delete_snapshot" :: held 30.612s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:07:17.482446 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-29b05445-6463-4c02-9fac-4667285d0e75 tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-d8089467-8aed-489d-952c-2bd623d58080-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:07:17.506914 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-29b05445-6463-4c02-9fac-4667285d0e75 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-d8089467-8aed-489d-952c-2bd623d58080-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:07:17.514559 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-29b05445-6463-4c02-9fac-4667285d0e75 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:07:23.860869 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:07:23.921386 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (adcc0bfb-4d1c-4597-a04f-572dbfb6f550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:07:23.929398 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38baf7a7-ae6f-462c-bdc0-04c7d705e7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:07:23.952352 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38baf7a7-ae6f-462c-bdc0-04c7d705e7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-170793375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=636027aa-4bd0-4937-b625-4929d9464061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a42c3ecf474883ac652fcc8c01c9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:07:24Z,use_quota=True,user_id='7e3820b31a424c3a9216a6ef91fcb285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:07:23.964809 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929f4d87-d090-4ec9-927e-36e709b51f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:07:23.969857 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929f4d87-d090-4ec9-927e-36e709b51f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:07:23.978525 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3eb31a-fbc8-4e0f-9367-4ac7f42bde0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:07:24.163785 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3eb31a-fbc8-4e0f-9367-4ac7f42bde0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '636027aa-4bd0-4937-b625-4929d9464061', 'volume_name': 'volume-636027aa-4bd0-4937-b625-4929d9464061', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:07:24.169212 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d71f8ff-1f88-4ec0-82be-a1f5d9532680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:07:24.173025 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d71f8ff-1f88-4ec0-82be-a1f5d9532680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:07:24.185750 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f17b94-7997-45a8-9889-0eb01c513a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:07:24.186916 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Volume 636027aa-4bd0-4937-b625-4929d9464061: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-636027aa-4bd0-4937-b625-4929d9464061', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 21:07:24.187596 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Cloning 636027aa-4bd0-4937-b625-4929d9464061 from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 21:07:24.188381 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:07:24.216626 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.028s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:07:24.241176 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 7, 24, 227071)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:07:24.241680 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:07:24.242108 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 21:07:24.248514 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.032s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:07:24.249466 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 21:07:24.258974 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 7, 24, 255422)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:07:24.259638 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:07:24.260194 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 21:07:24.298800 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:07:24.378774 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] creating snapshot='volume-636027aa-4bd0-4937-b625-4929d9464061.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:07:25.064506 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-636027aa-4bd0-4937-b625-4929d9464061.clone_snap' to 'volume-636027aa-4bd0-4937-b625-4929d9464061' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:07:25.275924 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:07:25.277333 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:07:25.277892 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:07:25.303212 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:07:25.303915 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Marking volume 636027aa-4bd0-4937-b625-4929d9464061 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:07:25.319433 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to 636027aa-4bd0-4937-b625-4929d9464061. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 21:07:25.320023 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Creating volume glance metadata for volume 636027aa-4bd0-4937-b625-4929d9464061 backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 21:07:25.413385 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f17b94-7997-45a8-9889-0eb01c513a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636027aa-4bd0-4937-b625-4929d9464061', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:07:25.418928 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e2ba33-08be-44e9-a75a-7e8f10dfc0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:07:25.445511 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Volume volume-636027aa-4bd0-4937-b625-4929d9464061 (636027aa-4bd0-4937-b625-4929d9464061): created successfully Oct 22 21:07:25.465445 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e2ba33-08be-44e9-a75a-7e8f10dfc0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:07:25.494423 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (adcc0bfb-4d1c-4597-a04f-572dbfb6f550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:07:25.531618 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-52d78fe8-7e18-41e6-9838-b5f2d8079595 tempest-TestVolumeBootPattern-1443368191 None] Created volume successfully. Oct 22 21:07:26.656055 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=45,cinder:UPDATE=22,cinder:INSERT=14,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:30.509912 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:07:30.510629 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:07:30.617280 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:07:30.703495 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:07:31.418196 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-6b10b298-9d7d-448c-9f4d-257ff0943f6c req-a78e9c6e-53a6-4019-992f-1487d95d9443 tempest-TestVolumeBootPattern-1443368191 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:07:33.515094 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-6b10b298-9d7d-448c-9f4d-257ff0943f6c req-a78e9c6e-53a6-4019-992f-1487d95d9443 tempest-TestVolumeBootPattern-1443368191 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.100s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:07:33.515901 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-6b10b298-9d7d-448c-9f4d-257ff0943f6c req-a78e9c6e-53a6-4019-992f-1487d95d9443 tempest-TestVolumeBootPattern-1443368191 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-636027aa-4bd0-4937-b625-4929d9464061', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '636027aa-4bd0-4937-b625-4929d9464061', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:07:33.578811 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-6b10b298-9d7d-448c-9f4d-257ff0943f6c req-a78e9c6e-53a6-4019-992f-1487d95d9443 tempest-TestVolumeBootPattern-1443368191 None] Connection info returned from driver {'name': 'volumes/volume-636027aa-4bd0-4937-b625-4929d9464061', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '636027aa-4bd0-4937-b625-4929d9464061', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2a688b14-3a0b-498f-a671-d5490d06fd0e'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:07:33.649393 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=64,cinder:UPDATE=25,cinder:INSERT=10,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:33.686894 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-6b10b298-9d7d-448c-9f4d-257ff0943f6c req-a78e9c6e-53a6-4019-992f-1487d95d9443 tempest-TestVolumeBootPattern-1443368191 None] attachment_update completed successfully. Oct 22 21:07:46.667468 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:07:47.862265 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-29b05445-6463-4c02-9fac-4667285d0e75 tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['aba2230b-4c6b-485c-b8cd-00a505d1f0e9', '3fcf1818-6382-4bdd-bbbc-21bcf1feb311', 'df71c514-2ff3-4c7b-8942-83f0a6de9d9d', '36b8902c-c42b-414d-b417-33584c0cb31f'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:07:47.956477 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-29b05445-6463-4c02-9fac-4667285d0e75 tempest-VolumesSnapshotTestJSON-1543447304 None] Delete snapshot completed successfully. Oct 22 21:07:47.966989 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-29b05445-6463-4c02-9fac-4667285d0e75 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-d8089467-8aed-489d-952c-2bd623d58080-delete_snapshot" released by "delete_snapshot" :: held 30.460s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:07:49.764543 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 req-e36231f3-9cb3-44c4-ac06-a7d3bf80e938 tempest-VolumesSnapshotTestJSON-1543447304 None] Terminate volume connection completed successfully. Oct 22 21:07:49.765156 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-23b295e9-f6a6-4e29-a353-4ce15e4d6505 req-e36231f3-9cb3-44c4-ac06-a7d3bf80e938 tempest-VolumesSnapshotTestJSON-1543447304 None] Deleting attachment 31f49fe2-deb2-40c3-887d-818661b5a97b. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:07:56.984355 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f552916a-3400-4270-8fd6-d7c618e66896 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:07:58.199966 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f552916a-3400-4270-8fd6-d7c618e66896 tempest-VolumesSnapshotTestJSON-1543447304 None] Create snapshot completed successfully Oct 22 21:07:59.232705 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a672db0d-1e69-465c-841c-306ce6135608 tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-9668d5a8-a824-4d81-a1a0-13dfbb47c0ce-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:07:59.242337 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a672db0d-1e69-465c-841c-306ce6135608 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-9668d5a8-a824-4d81-a1a0-13dfbb47c0ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:07:59.243801 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a672db0d-1e69-465c-841c-306ce6135608 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:00.373075 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a672db0d-1e69-465c-841c-306ce6135608 tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['fdc84295-d61d-455e-a60a-e833b7262b2b', 'f297e82b-2d79-4e21-b1f7-9891514cec67', 'e79193be-d479-4f47-8170-39050343bbd2', '9f8f920d-da35-41ad-b3c9-21f5223769bc'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:08:00.455272 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a672db0d-1e69-465c-841c-306ce6135608 tempest-VolumesSnapshotTestJSON-1543447304 None] Delete snapshot completed successfully. Oct 22 21:08:00.464739 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a672db0d-1e69-465c-841c-306ce6135608 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-9668d5a8-a824-4d81-a1a0-13dfbb47c0ce-delete_snapshot" released by "delete_snapshot" :: held 1.222s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:08:01.705009 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a9a6a23b-6455-441d-94ec-f2f80a15da9b tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:02.379064 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a9a6a23b-6455-441d-94ec-f2f80a15da9b tempest-VolumesSnapshotTestJSON-1543447304 None] Create snapshot completed successfully Oct 22 21:08:06.670368 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=47,cinder:UPDATE=16,cinder:INSERT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:20.083325 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=25,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:20.096829 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-1ab9765e-be59-41b3-9b6e-3584b707494a req-5f74bc8c-20d2-42d3-adae-a2eb3ff81e57 tempest-VolumesSnapshotTestJSON-1543447304 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:08:20.970062 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-1ab9765e-be59-41b3-9b6e-3584b707494a req-5f74bc8c-20d2-42d3-adae-a2eb3ff81e57 tempest-VolumesSnapshotTestJSON-1543447304 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.873s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:08:20.970989 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-1ab9765e-be59-41b3-9b6e-3584b707494a req-5f74bc8c-20d2-42d3-adae-a2eb3ff81e57 tempest-VolumesSnapshotTestJSON-1543447304 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b9959707-0ed2-44c8-9e98-fa250b2609b9', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'b9959707-0ed2-44c8-9e98-fa250b2609b9', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:08:21.005219 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-1ab9765e-be59-41b3-9b6e-3584b707494a req-5f74bc8c-20d2-42d3-adae-a2eb3ff81e57 tempest-VolumesSnapshotTestJSON-1543447304 None] Connection info returned from driver {'name': 'volumes/volume-b9959707-0ed2-44c8-9e98-fa250b2609b9', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b9959707-0ed2-44c8-9e98-fa250b2609b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c23df082-e49d-4bbf-b804-1a1fd2fd8966'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:08:21.083888 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-1ab9765e-be59-41b3-9b6e-3584b707494a req-5f74bc8c-20d2-42d3-adae-a2eb3ff81e57 tempest-VolumesSnapshotTestJSON-1543447304 None] attachment_update completed successfully. Oct 22 21:08:23.608837 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0f22cef8-3798-46f5-a04f-cc8ec5f72ce1 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:24.228148 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-0f22cef8-3798-46f5-a04f-cc8ec5f72ce1 tempest-VolumesSnapshotTestJSON-1543447304 None] Create snapshot completed successfully Oct 22 21:08:24.854396 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cf185db2-d556-4170-a183-da4db1847005 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:25.263569 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-cf185db2-d556-4170-a183-da4db1847005 tempest-VolumesSnapshotTestJSON-1543447304 None] Create snapshot completed successfully Oct 22 21:08:25.925328 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4a3074df-500a-47b9-9854-3d9639274023 tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-ae78dc44-32a5-421a-aa53-0aa09eccb230-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:08:25.948416 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4a3074df-500a-47b9-9854-3d9639274023 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-ae78dc44-32a5-421a-aa53-0aa09eccb230-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:08:25.950647 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4a3074df-500a-47b9-9854-3d9639274023 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:30.510258 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:08:30.511872 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:30.585951 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:30.641779 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:08:36.692613 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=27,cinder:UPDATE=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:52.276144 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:08:52.303830 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Flow 'volume_create_manager' (7dd9ccc3-cf12-4346-b294-bdbf65a6c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:08:52.311532 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b42c030-2354-450e-a219-fb9d9837ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:52.317395 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=26,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:08:52.338537 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b42c030-2354-450e-a219-fb9d9837ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-260373374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e181745b-d71c-49fd-8bff-fbeab4fe3a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52be7dbbbb564c21a11f0597368f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:08:52Z,use_quota=True,user_id='a412a877095a48628146bd1c23ebeddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:52.347525 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecd19a8-f879-4ec3-94d9-20b903ead9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:52.364455 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecd19a8-f879-4ec3-94d9-20b903ead9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:52.372906 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a25a179-1b30-4829-a40b-d98c50219ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:52.377463 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a25a179-1b30-4829-a40b-d98c50219ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e181745b-d71c-49fd-8bff-fbeab4fe3a88', 'volume_name': 'volume-e181745b-d71c-49fd-8bff-fbeab4fe3a88', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:52.382203 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d8fbbf-9708-4dde-9f43-93a5306a6438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:52.386405 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d8fbbf-9708-4dde-9f43-93a5306a6438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:52.392943 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a816ddd8-7c8f-439d-adbb-0601f71728ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:52.394667 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Volume e181745b-d71c-49fd-8bff-fbeab4fe3a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e181745b-d71c-49fd-8bff-fbeab4fe3a88', 'volume_size': 1} Oct 22 21:08:52.395310 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] creating volume 'volume-e181745b-d71c-49fd-8bff-fbeab4fe3a88' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:08:52.396528 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:52.499551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:08:52.499761 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:08:52.503952 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a816ddd8-7c8f-439d-adbb-0601f71728ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e181745b-d71c-49fd-8bff-fbeab4fe3a88', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:52.508680 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce8b5ac-aae9-432c-91f1-3111edcc068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:52.526953 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Volume volume-e181745b-d71c-49fd-8bff-fbeab4fe3a88 (e181745b-d71c-49fd-8bff-fbeab4fe3a88): created successfully Oct 22 21:08:52.532891 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce8b5ac-aae9-432c-91f1-3111edcc068f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:52.540590 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Flow 'volume_create_manager' (7dd9ccc3-cf12-4346-b294-bdbf65a6c422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:08:52.554668 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-f9e45d77-1c5e-4f2c-97e9-4da17026874c req-4026a4dc-f5c3-400a-9797-217a0fe79965 tempest-VolumesSnapshotsTestJSON-449412194 None] Created volume successfully. Oct 22 21:08:53.662729 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-ae7473c8-ec92-40c0-9ab7-02ed72caf890 req-6fe773fb-cd19-4a2c-9adf-a50acf743826 tempest-VolumesSnapshotsTestJSON-449412194 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:54.418079 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-ae7473c8-ec92-40c0-9ab7-02ed72caf890 req-6fe773fb-cd19-4a2c-9adf-a50acf743826 tempest-VolumesSnapshotsTestJSON-449412194 None] Create snapshot completed successfully Oct 22 21:08:54.965889 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-0b3f3f90-2a16-4412-a867-5ad009b4d2cc req-4565abff-0352-40d8-89b7-c417202613fa tempest-VolumesSnapshotsTestJSON-449412194 None] Acquiring lock "cinder-c61ef67d-4c62-4cbf-9b87-4c8aafc614ed-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:08:54.985084 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-0b3f3f90-2a16-4412-a867-5ad009b4d2cc req-4565abff-0352-40d8-89b7-c417202613fa tempest-VolumesSnapshotsTestJSON-449412194 None] Lock "cinder-c61ef67d-4c62-4cbf-9b87-4c8aafc614ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:08:54.988470 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-0b3f3f90-2a16-4412-a867-5ad009b4d2cc req-4565abff-0352-40d8-89b7-c417202613fa tempest-VolumesSnapshotsTestJSON-449412194 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:55.444707 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [req-0b3f3f90-2a16-4412-a867-5ad009b4d2cc req-4565abff-0352-40d8-89b7-c417202613fa tempest-VolumesSnapshotsTestJSON-449412194 None] Created reservations ['33212187-6c68-4a0a-a3f7-37363ac809a0', '0955d4d7-39e7-49b6-8ef0-dbe8926d4cb2', '9f6a2083-da9f-404e-bdd6-fd46ac449962', 'f60205f9-39ac-4b23-99ab-d22ed73a94b2'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:08:55.495159 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-0b3f3f90-2a16-4412-a867-5ad009b4d2cc req-4565abff-0352-40d8-89b7-c417202613fa tempest-VolumesSnapshotsTestJSON-449412194 None] Delete snapshot completed successfully. Oct 22 21:08:55.500244 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-0b3f3f90-2a16-4412-a867-5ad009b4d2cc req-4565abff-0352-40d8-89b7-c417202613fa tempest-VolumesSnapshotsTestJSON-449412194 None] Lock "cinder-c61ef67d-4c62-4cbf-9b87-4c8aafc614ed-delete_snapshot" released by "delete_snapshot" :: held 0.515s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:08:56.192788 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-4a3074df-500a-47b9-9854-3d9639274023 tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['dc5ae382-3a0c-4b01-9fb3-0405320789fd', '9dca7e5f-634a-4614-b992-f81ce260d3f2', '87f24ae5-10aa-4f1f-a9c1-353d099744eb', '7ca6cfe8-716e-439b-82b1-ac463a1a11d5'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:08:56.220480 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] Acquiring lock "cinder-e181745b-d71c-49fd-8bff-fbeab4fe3a88-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:08:56.246117 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] Lock "cinder-e181745b-d71c-49fd-8bff-fbeab4fe3a88-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:08:56.276574 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4a3074df-500a-47b9-9854-3d9639274023 tempest-VolumesSnapshotTestJSON-1543447304 None] Delete snapshot completed successfully. Oct 22 21:08:56.295453 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4a3074df-500a-47b9-9854-3d9639274023 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-ae78dc44-32a5-421a-aa53-0aa09eccb230-delete_snapshot" released by "delete_snapshot" :: held 30.347s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:08:56.297505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:56.381030 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:08:56.381655 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] Volume volume-e181745b-d71c-49fd-8bff-fbeab4fe3a88 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:08:56.392056 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] deleting rbd volume volume-e181745b-d71c-49fd-8bff-fbeab4fe3a88 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:08:56.472821 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c40be091-d00d-41fd-a4fb-0fdff89b3b3e tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-36da485c-83f8-456b-8d86-9557d22bed1e-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:08:56.495236 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c40be091-d00d-41fd-a4fb-0fdff89b3b3e tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-36da485c-83f8-456b-8d86-9557d22bed1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:08:56.498101 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c40be091-d00d-41fd-a4fb-0fdff89b3b3e tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:56.792657 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] Created reservations ['6b9000c8-3a19-4fec-8b85-a03127284f16', 'f1d4176d-0f64-466a-a94a-23c0b76e8320', '3551e6f9-b3c2-4579-862c-72036a1389cf', '730f158a-81de-4c84-bc1d-ef1cf323dc51'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:08:56.849315 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:56.902181 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:56.969870 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:08:56.977041 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] Deleted volume successfully. Oct 22 21:08:56.993945 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-534591ad-8945-40a6-8dbd-b8d7eb5e6285 req-b38d0faa-e0eb-4fe7-8cf6-35bb4b6335ae tempest-VolumesSnapshotsTestJSON-449412194 None] Lock "cinder-e181745b-d71c-49fd-8bff-fbeab4fe3a88-delete_volume" released by "delete_volume" :: held 0.748s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:08:59.593947 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:08:59.667431 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Flow 'volume_create_manager' (863bb9de-db91-415c-9d7c-02e133b11836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:08:59.673688 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cda12af-e9b9-4af5-9df6-1c778d514eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:59.690910 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cda12af-e9b9-4af5-9df6-1c778d514eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-360996344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7c24f6c6-7a13-4422-8162-fa5bba0b4323,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3fd24f990acf41f3b16fc3fae5100ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:09:00Z,use_quota=True,user_id='3cc52c866a8f428ebd7ebf0f1b72ec86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:59.695941 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f39fc9-9491-4053-a419-a02c52794f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:59.699805 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f39fc9-9491-4053-a419-a02c52794f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:59.704533 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3362aea1-4b25-43cd-8ef5-7ad80733a507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:59.708291 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3362aea1-4b25-43cd-8ef5-7ad80733a507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c24f6c6-7a13-4422-8162-fa5bba0b4323', 'volume_name': 'volume-7c24f6c6-7a13-4422-8162-fa5bba0b4323', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:59.712803 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fbe31d-b4d1-4d2f-8399-09043f9cd6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:59.716439 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fbe31d-b4d1-4d2f-8399-09043f9cd6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:59.720987 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e57b838-24c3-4bbe-9146-9581cfc4cdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:59.722008 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Volume 7c24f6c6-7a13-4422-8162-fa5bba0b4323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c24f6c6-7a13-4422-8162-fa5bba0b4323', 'volume_size': 1} Oct 22 21:08:59.722394 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] creating volume 'volume-7c24f6c6-7a13-4422-8162-fa5bba0b4323' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:08:59.723165 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:08:59.779891 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:08:59.780273 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:08:59.784277 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e57b838-24c3-4bbe-9146-9581cfc4cdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c24f6c6-7a13-4422-8162-fa5bba0b4323', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:59.788333 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effac310-5b9a-412c-82e4-545c7c045883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:08:59.798192 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Volume volume-7c24f6c6-7a13-4422-8162-fa5bba0b4323 (7c24f6c6-7a13-4422-8162-fa5bba0b4323): created successfully Oct 22 21:08:59.801770 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effac310-5b9a-412c-82e4-545c7c045883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:08:59.806991 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Flow 'volume_create_manager' (863bb9de-db91-415c-9d7c-02e133b11836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:08:59.817001 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7998ad20-ac37-453f-82bc-44ffee6bc67f tempest-VolumesTestJSON-308592156 None] Created volume successfully. Oct 22 21:09:00.993882 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:09:01.013679 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Flow 'volume_create_manager' (93d25669-7155-4a9c-ba06-792ece46ea93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:09:01.019881 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef41c80-51a1-4394-9fff-8bdc73594632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:01.036358 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef41c80-51a1-4394-9fff-8bdc73594632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-351462978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=08af570e-e95c-4687-b224-57bb57ede083,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3fd24f990acf41f3b16fc3fae5100ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:09:01Z,use_quota=True,user_id='3cc52c866a8f428ebd7ebf0f1b72ec86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:01.041528 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213de613-8856-4ebb-b538-1e663ed51a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:01.045417 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213de613-8856-4ebb-b538-1e663ed51a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:01.050457 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9210a5f-2012-4001-b5c0-2539798c6cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:01.054332 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9210a5f-2012-4001-b5c0-2539798c6cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08af570e-e95c-4687-b224-57bb57ede083', 'volume_name': 'volume-08af570e-e95c-4687-b224-57bb57ede083', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:01.058946 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5482e6-9507-423a-af5f-84291f981e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:01.062727 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5482e6-9507-423a-af5f-84291f981e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:01.067374 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f50ecd-7255-4d21-ae34-ed1379884ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:01.068188 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Volume 08af570e-e95c-4687-b224-57bb57ede083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08af570e-e95c-4687-b224-57bb57ede083', 'volume_size': 1} Oct 22 21:09:01.068577 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] creating volume 'volume-08af570e-e95c-4687-b224-57bb57ede083' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:09:01.069539 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:01.129954 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:09:01.130399 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:09:01.134133 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f50ecd-7255-4d21-ae34-ed1379884ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08af570e-e95c-4687-b224-57bb57ede083', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:01.138612 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85348c04-19ce-4649-9341-509e4a2f6c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:01.151782 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Volume volume-08af570e-e95c-4687-b224-57bb57ede083 (08af570e-e95c-4687-b224-57bb57ede083): created successfully Oct 22 21:09:01.156635 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85348c04-19ce-4649-9341-509e4a2f6c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:01.162293 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Flow 'volume_create_manager' (93d25669-7155-4a9c-ba06-792ece46ea93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:09:01.171898 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f244def2-b37d-4428-81e1-b12fe79029ac tempest-VolumesTestJSON-308592156 None] Created volume successfully. Oct 22 21:09:02.415107 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:09:02.433326 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Flow 'volume_create_manager' (2550bab8-956c-4abb-8bda-6c945d0794a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:09:02.439371 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445675aa-3dbd-4938-984b-48a48d90b875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:02.454991 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445675aa-3dbd-4938-984b-48a48d90b875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1500650716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3fd24f990acf41f3b16fc3fae5100ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:09:02Z,use_quota=True,user_id='3cc52c866a8f428ebd7ebf0f1b72ec86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:02.459906 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fbdc27-a4aa-4d45-9bae-37835231fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:02.463784 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fbdc27-a4aa-4d45-9bae-37835231fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:02.468609 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6103763-62cc-45a8-98dd-e0df64a610af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:02.472424 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6103763-62cc-45a8-98dd-e0df64a610af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1', 'volume_name': 'volume-ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:02.477319 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96be5fc0-9f18-4e85-8be1-dcfe4c49daa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:02.480947 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96be5fc0-9f18-4e85-8be1-dcfe4c49daa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:02.485495 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65eb8ddd-fc16-4293-bf64-96a42a23897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:02.486523 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Volume ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1', 'volume_size': 1} Oct 22 21:09:02.486907 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] creating volume 'volume-ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:09:02.487572 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:02.545894 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:09:02.546349 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:09:02.550501 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65eb8ddd-fc16-4293-bf64-96a42a23897a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:02.555760 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248b2346-a740-494d-b480-5c5fba459ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:02.566263 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Volume volume-ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1 (ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1): created successfully Oct 22 21:09:02.570728 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248b2346-a740-494d-b480-5c5fba459ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:02.576437 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Flow 'volume_create_manager' (2550bab8-956c-4abb-8bda-6c945d0794a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:09:02.587067 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-40011ec4-e92e-47fd-93b1-16345dd83ecf tempest-VolumesTestJSON-308592156 None] Created volume successfully. Oct 22 21:09:04.678904 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] Acquiring lock "cinder-ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:09:04.690085 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] Lock "cinder-ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:09:04.741527 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:04.818237 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:09:04.818932 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] Volume volume-ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:09:04.825515 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] deleting rbd volume volume-ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:09:05.044497 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=59,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:05.078933 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] Created reservations ['cd9b7804-9cef-46c4-98e6-5d49858b5469', '1579f2ec-4eb9-4c6e-bdb5-ebea9d5824d2', 'fceb6184-6672-4c65-b3dd-eaf42c85fad7', '1fe56393-a952-4f1e-ac3a-be922724cd33'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:09:05.096172 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=62,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=10 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:05.141731 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:05.195972 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:05.234736 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:09:05.243000 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] Deleted volume successfully. Oct 22 21:09:05.264669 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-201f610d-68a7-47d9-9b34-6b9260999287 tempest-VolumesTestJSON-308592156 None] Lock "cinder-ecbbed2a-c5b0-45e9-a1fa-b67ff66c50b1-delete_volume" released by "delete_volume" :: held 0.575s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:09:05.840829 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] Acquiring lock "cinder-08af570e-e95c-4687-b224-57bb57ede083-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:09:05.860543 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] Lock "cinder-08af570e-e95c-4687-b224-57bb57ede083-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:09:05.901682 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:05.939095 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:09:05.939557 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] Volume volume-08af570e-e95c-4687-b224-57bb57ede083 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:09:05.944384 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] deleting rbd volume volume-08af570e-e95c-4687-b224-57bb57ede083 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:09:06.159499 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] Created reservations ['5fd01f4c-a869-463b-aa19-6c34afad61b0', '71757829-c921-4ead-aa0d-37eb9f7a5fa6', '1f41b357-fc32-467f-8d39-e58f8dfff4ff', '641b046d-e93e-4c47-9366-1c1176fc18f0'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:09:06.213779 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:06.268299 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:06.304608 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:09:06.309354 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] Deleted volume successfully. Oct 22 21:09:06.323499 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5963bcaa-00a4-4b9a-a353-79dbb5ea2c9b tempest-VolumesTestJSON-308592156 None] Lock "cinder-08af570e-e95c-4687-b224-57bb57ede083-delete_volume" released by "delete_volume" :: held 0.463s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:09:07.004588 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] Acquiring lock "cinder-7c24f6c6-7a13-4422-8162-fa5bba0b4323-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:09:07.029044 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] Lock "cinder-7c24f6c6-7a13-4422-8162-fa5bba0b4323-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:09:07.101080 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:07.161601 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:09:07.162516 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] Volume volume-7c24f6c6-7a13-4422-8162-fa5bba0b4323 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:09:07.169299 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] deleting rbd volume volume-7c24f6c6-7a13-4422-8162-fa5bba0b4323 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:09:07.389358 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] Created reservations ['cdce8d94-5f42-4e20-9dd9-f7c4658fd1fa', '179eafbf-55a0-4139-8914-3ade313c0e7a', 'ce9d1cfd-1b89-4846-86c8-551e0b1c4ca8', 'b2cee824-b56c-426f-850c-0c443024387f'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:09:07.439803 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:07.472548 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:07.529662 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:09:07.553772 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] Deleted volume successfully. Oct 22 21:09:07.569784 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-fe5a4f55-154d-4f6f-bcd2-a8475e90dd26 tempest-VolumesTestJSON-308592156 None] Lock "cinder-7c24f6c6-7a13-4422-8162-fa5bba0b4323-delete_volume" released by "delete_volume" :: held 0.540s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:09:09.613775 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:09:09.642847 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Flow 'volume_create_manager' (196e8696-9ae0-4b23-827e-795949c12d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:09:09.656937 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e3b27b-b9c0-4551-9bca-e18171c1b8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:09.672999 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e3b27b-b9c0-4551-9bca-e18171c1b8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-263399277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5f27abb4-b6a0-4d25-b866-b5618e5dd0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='755501ba3e344f1aaf7ef80924bb57d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:09:10Z,use_quota=True,user_id='ba0d0bdfb04240209e4efa92f47cbb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:09.679033 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235f348b-8406-4522-8cbe-413ee35c2cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:09.683645 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235f348b-8406-4522-8cbe-413ee35c2cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:09.688509 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57a0079-9012-4aaf-a79a-bdbf7deaf60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:09.692442 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57a0079-9012-4aaf-a79a-bdbf7deaf60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f27abb4-b6a0-4d25-b866-b5618e5dd0dc', 'volume_name': 'volume-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:09.697065 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c5b0b2-213d-4939-b1ae-c21945e0c6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:09.700902 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c5b0b2-213d-4939-b1ae-c21945e0c6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:09.705360 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589b99d0-33e3-4bc5-91f6-8ca2fb3e2363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:09.706430 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Volume 5f27abb4-b6a0-4d25-b866-b5618e5dd0dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc', 'volume_size': 1} Oct 22 21:09:09.706826 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] creating volume 'volume-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:09:09.707615 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:09.783381 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:09:09.783754 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:09:09.787295 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589b99d0-33e3-4bc5-91f6-8ca2fb3e2363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:09.791752 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3cb7b0-eba8-4362-b3b1-eddcaf466170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:09.804794 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Volume volume-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc (5f27abb4-b6a0-4d25-b866-b5618e5dd0dc): created successfully Oct 22 21:09:09.808665 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3cb7b0-eba8-4362-b3b1-eddcaf466170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:09.814832 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Flow 'volume_create_manager' (196e8696-9ae0-4b23-827e-795949c12d72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:09:09.825024 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-899b21e7-b05f-4924-b677-6e54b658eb2b tempest-AttachVolumeTestJSON-485250435 None] Created volume successfully. Oct 22 21:09:11.129401 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-98d4cf3f-3fde-4974-b449-c23898c896f7 req-07d25aa4-27b8-47c1-877a-d61a2a143d82 tempest-AttachVolumeTestJSON-485250435 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:09:11.909520 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-98d4cf3f-3fde-4974-b449-c23898c896f7 req-07d25aa4-27b8-47c1-877a-d61a2a143d82 tempest-AttachVolumeTestJSON-485250435 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.780s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:09:11.910614 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-98d4cf3f-3fde-4974-b449-c23898c896f7 req-07d25aa4-27b8-47c1-877a-d61a2a143d82 tempest-AttachVolumeTestJSON-485250435 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '5f27abb4-b6a0-4d25-b866-b5618e5dd0dc', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:09:11.938218 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-98d4cf3f-3fde-4974-b449-c23898c896f7 req-07d25aa4-27b8-47c1-877a-d61a2a143d82 tempest-AttachVolumeTestJSON-485250435 None] Connection info returned from driver {'name': 'volumes/volume-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5f27abb4-b6a0-4d25-b866-b5618e5dd0dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aaa21c29-9a7f-48fc-9790-33024de31e8b'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:09:12.009368 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-98d4cf3f-3fde-4974-b449-c23898c896f7 req-07d25aa4-27b8-47c1-877a-d61a2a143d82 tempest-AttachVolumeTestJSON-485250435 None] attachment_update completed successfully. Oct 22 21:09:26.720033 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=61,cinder:UPDATE=32,cinder:INSERT=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:26.729542 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-c40be091-d00d-41fd-a4fb-0fdff89b3b3e tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['a45324b6-dc75-4998-915f-a0b4e364c7c7', 'f4a9b6f3-a927-41a5-aab8-eab72bdc1d88', '2be2dc26-da38-462c-bda8-c684b2ff5539', 'ba1ada3f-045f-453e-93be-1dc2deaf66ba'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:09:26.788944 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c40be091-d00d-41fd-a4fb-0fdff89b3b3e tempest-VolumesSnapshotTestJSON-1543447304 None] Delete snapshot completed successfully. Oct 22 21:09:26.795704 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c40be091-d00d-41fd-a4fb-0fdff89b3b3e tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-36da485c-83f8-456b-8d86-9557d22bed1e-delete_snapshot" released by "delete_snapshot" :: held 30.300s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:09:27.817613 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-bfb31502-efdf-4082-bc97-7bce2f2d9b2a tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-de4a3f53-c531-4420-9723-2dd4391bcc51-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:09:27.832551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-bfb31502-efdf-4082-bc97-7bce2f2d9b2a tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-de4a3f53-c531-4420-9723-2dd4391bcc51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:09:27.834978 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bfb31502-efdf-4082-bc97-7bce2f2d9b2a tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:30.514574 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:09:30.516797 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:30.601684 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:30.678833 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:09:34.033748 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:09:34.071456 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Flow 'volume_create_manager' (d1541d84-011a-4797-9913-2f2bad373ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:09:34.089310 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd6a791-cbc2-4f08-8e63-063d75f88fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:34.152654 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd6a791-cbc2-4f08-8e63-063d75f88fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-789194625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c67610e1-af2e-402f-8cee-c3d2c0eb9bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f28cafad8942518b882192687b8b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:09:34Z,use_quota=True,user_id='eb24324c9c174645a3e9bc8bb913afe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:34.188532 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82681a01-62fc-488a-8d01-bbcda06b907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:34.202312 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82681a01-62fc-488a-8d01-bbcda06b907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:34.213931 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0c67d2-29a1-4a36-9df3-b71f32a5123c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:34.230859 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0c67d2-29a1-4a36-9df3-b71f32a5123c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67610e1-af2e-402f-8cee-c3d2c0eb9bfd', 'volume_name': 'volume-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:34.237751 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4ef2ad-f74b-4214-9048-c19a86025602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:34.253073 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4ef2ad-f74b-4214-9048-c19a86025602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:34.263865 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0fb87f-f5d7-49a6-8937-44c3526f2673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:34.268663 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Volume c67610e1-af2e-402f-8cee-c3d2c0eb9bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd', 'volume_size': 1} Oct 22 21:09:34.270241 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] creating volume 'volume-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:09:34.272260 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:34.449291 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:09:34.449661 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:09:34.453463 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0fb87f-f5d7-49a6-8937-44c3526f2673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:34.462710 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13535377-6c36-4cb9-ace8-30f35ae1b663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:34.499056 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Volume volume-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd (c67610e1-af2e-402f-8cee-c3d2c0eb9bfd): created successfully Oct 22 21:09:34.502583 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13535377-6c36-4cb9-ace8-30f35ae1b663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:34.522377 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Flow 'volume_create_manager' (d1541d84-011a-4797-9913-2f2bad373ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:09:34.543952 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-ff6baa9d-e5f4-43ab-826e-112fd4b22ad3 tempest-AttachVolumeShelveTestJSON-1454811106 None] Created volume successfully. Oct 22 21:09:36.673393 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=30,cinder:DELETE=4,cinder:SELECT=50,cinder:INSERT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:39.817682 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:09:39.848383 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Flow 'volume_create_manager' (23a847f1-e7dc-4aab-838f-b48c2d52c324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:09:39.862185 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5205432-21de-4567-9eda-4417449b9674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:39.904898 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5205432-21de-4567-9eda-4417449b9674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-990666458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=49bf8882-4d00-468f-a20f-effc54a1c736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddce0c46c75496f96f2e2dae77751dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:09:40Z,use_quota=True,user_id='67e7a09f769748629425ad36120a7fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:39.914215 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba7d792-c148-408f-b39c-70851d4bed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:39.918651 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba7d792-c148-408f-b39c-70851d4bed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:39.925763 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce623dcb-06c6-43b1-aa96-b56894b64d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:39.930882 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce623dcb-06c6-43b1-aa96-b56894b64d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49bf8882-4d00-468f-a20f-effc54a1c736', 'volume_name': 'volume-49bf8882-4d00-468f-a20f-effc54a1c736', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:39.942896 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7cb6bb-5a94-46b8-995b-b6035a0d5f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:39.947077 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7cb6bb-5a94-46b8-995b-b6035a0d5f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:39.952139 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cda8d2-7030-4550-92c9-0cee83cf3608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:39.953558 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Volume 49bf8882-4d00-468f-a20f-effc54a1c736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49bf8882-4d00-468f-a20f-effc54a1c736', 'volume_size': 1} Oct 22 21:09:39.954050 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] creating volume 'volume-49bf8882-4d00-468f-a20f-effc54a1c736' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:09:39.954958 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:09:40.073683 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:09:40.074140 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:09:40.079297 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cda8d2-7030-4550-92c9-0cee83cf3608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49bf8882-4d00-468f-a20f-effc54a1c736', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:40.086249 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9293cbb2-d954-4740-9215-992d055093cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:09:40.102643 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Volume volume-49bf8882-4d00-468f-a20f-effc54a1c736 (49bf8882-4d00-468f-a20f-effc54a1c736): created successfully Oct 22 21:09:40.108847 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9293cbb2-d954-4740-9215-992d055093cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:09:40.116338 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Flow 'volume_create_manager' (23a847f1-e7dc-4aab-838f-b48c2d52c324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:09:40.131374 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2292aea3-1bc1-416a-ae17-da8e7db7b9d6 tempest-ServerRescueNegativeTestJSON-610226422 None] Created volume successfully. Oct 22 21:09:58.035821 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=20,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:09:58.140773 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-bfb31502-efdf-4082-bc97-7bce2f2d9b2a tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['a5f73d77-998a-41a5-9973-32f5d5c147a0', 'd603e9bb-5d82-45a6-ae95-8a672007f2a3', 'af38f543-fef3-4b89-bfad-af3eeb13da92', '0fd3c732-aa5c-41f3-9603-0b8597e85004'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:09:58.238746 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-bfb31502-efdf-4082-bc97-7bce2f2d9b2a tempest-VolumesSnapshotTestJSON-1543447304 None] Delete snapshot completed successfully. Oct 22 21:09:58.246606 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-bfb31502-efdf-4082-bc97-7bce2f2d9b2a tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-de4a3f53-c531-4420-9723-2dd4391bcc51-delete_snapshot" released by "delete_snapshot" :: held 30.414s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:10:01.037298 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-04c8db0c-3646-42c7-98fd-241814bbb216 req-58dc3d7e-4280-4f1e-b1c4-aabe6fb4cc0b tempest-VolumesSnapshotTestJSON-1543447304 None] Terminate volume connection completed successfully. Oct 22 21:10:01.043641 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-04c8db0c-3646-42c7-98fd-241814bbb216 req-58dc3d7e-4280-4f1e-b1c4-aabe6fb4cc0b tempest-VolumesSnapshotTestJSON-1543447304 None] Deleting attachment c23df082-e49d-4bbf-b804-1a1fd2fd8966. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:10:06.520439 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:10:06.572714 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Flow 'volume_create_manager' (6281f440-6c09-4826-9b5e-088fb8750928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:06.594382 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0517ac08-0d7a-4705-9a85-54246550c88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:06.651710 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0517ac08-0d7a-4705-9a85-54246550c88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1639968406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a27768b2-577b-4af0-8f2f-5c9897b3e528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddce0c46c75496f96f2e2dae77751dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:10:06Z,use_quota=True,user_id='67e7a09f769748629425ad36120a7fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:06.671644 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f886e6-8491-42af-9632-20d10b7285fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:06.683305 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f886e6-8491-42af-9632-20d10b7285fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:06.696916 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2229fba4-5ea0-4793-bf86-32455c2f1e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:06.707688 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2229fba4-5ea0-4793-bf86-32455c2f1e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27768b2-577b-4af0-8f2f-5c9897b3e528', 'volume_name': 'volume-a27768b2-577b-4af0-8f2f-5c9897b3e528', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:06.722025 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0caf09-403b-4f4a-aea1-4a366fee9eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:06.733831 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0caf09-403b-4f4a-aea1-4a366fee9eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:06.746189 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db5a9d1-0dfc-4792-acd9-bdf9dfd3f322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:06.748623 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Volume a27768b2-577b-4af0-8f2f-5c9897b3e528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27768b2-577b-4af0-8f2f-5c9897b3e528', 'volume_size': 1} Oct 22 21:10:06.753668 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] creating volume 'volume-a27768b2-577b-4af0-8f2f-5c9897b3e528' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:10:06.757720 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:06.836962 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=22,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:06.935201 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:10:06.935785 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:10:06.943005 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db5a9d1-0dfc-4792-acd9-bdf9dfd3f322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27768b2-577b-4af0-8f2f-5c9897b3e528', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:06.957122 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bc7c41-9a7d-45ca-b73b-f54d5ccc3e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:06.988721 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Volume volume-a27768b2-577b-4af0-8f2f-5c9897b3e528 (a27768b2-577b-4af0-8f2f-5c9897b3e528): created successfully Oct 22 21:10:07.000661 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bc7c41-9a7d-45ca-b73b-f54d5ccc3e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:07.008352 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Flow 'volume_create_manager' (6281f440-6c09-4826-9b5e-088fb8750928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:07.053586 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-998865a9-fa5b-4828-b755-58d9111663d4 tempest-ServerRescueNegativeTestJSON-610226422 None] Created volume successfully. Oct 22 21:10:11.559785 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:10:11.676120 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (227653f9-cfc3-4db8-997d-0e9db9d5d5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:11.705290 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e018dba9-b4f2-4410-b625-8fe41ef32504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:11.746719 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e018dba9-b4f2-4410-b625-8fe41ef32504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-685278056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=06675d37-d2f3-4db8-aa05-8bf30bd310c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21349e14fb39496c9996d5af817b7f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:10:11Z,use_quota=True,user_id='7102f7b674934e19b3d4a001b563d0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:11.756319 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac94f10d-f3d4-4a7b-92d4-36ac91029790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:11.763023 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac94f10d-f3d4-4a7b-92d4-36ac91029790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:11.770161 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcb5e48-eb1e-49c3-9329-ea4ae7e8c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:11.791558 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcb5e48-eb1e-49c3-9329-ea4ae7e8c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06675d37-d2f3-4db8-aa05-8bf30bd310c3', 'volume_name': 'volume-06675d37-d2f3-4db8-aa05-8bf30bd310c3', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:11.797667 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f023e84e-cc73-45c4-ac09-a56158cf168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:11.811768 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f023e84e-cc73-45c4-ac09-a56158cf168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:11.817229 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d86d84a-136f-4499-87ab-df8211d7eaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:11.818687 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume 06675d37-d2f3-4db8-aa05-8bf30bd310c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06675d37-d2f3-4db8-aa05-8bf30bd310c3', 'volume_size': 1} Oct 22 21:10:11.819257 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] creating volume 'volume-06675d37-d2f3-4db8-aa05-8bf30bd310c3' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:10:11.820088 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:11.941832 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:10:11.942789 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:10:11.947185 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d86d84a-136f-4499-87ab-df8211d7eaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06675d37-d2f3-4db8-aa05-8bf30bd310c3', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:11.954919 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077b54a1-6051-439f-a873-afb0855f4b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:11.987600 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume volume-06675d37-d2f3-4db8-aa05-8bf30bd310c3 (06675d37-d2f3-4db8-aa05-8bf30bd310c3): created successfully Oct 22 21:10:11.994312 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077b54a1-6051-439f-a873-afb0855f4b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:12.000460 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (227653f9-cfc3-4db8-997d-0e9db9d5d5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:12.029243 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5ad418af-ad63-4a18-b167-2228fd85e4f1 tempest-VolumesSnapshotTestJSON-1543447304 None] Created volume successfully. Oct 22 21:10:13.106642 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-924793d1-d72d-4741-88b8-0338aa27094e tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:13.312596 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:10:13.357965 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Flow 'volume_create_manager' (097f7ab4-5873-4e0b-9fd2-67cf10a49881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:13.369955 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d83401c-a930-4737-b3e4-8e58cfbe30fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:13.413662 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d83401c-a930-4737-b3e4-8e58cfbe30fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1380377287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=af9a7f61-9e74-4d62-8f44-7bb6c43f3d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09185bfad7944b199a490305c22ffc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:10:13Z,use_quota=True,user_id='d69c1f0203b047eeb6a9fa0a215a63c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:13.425966 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684a9c90-4a61-49c0-a428-351db2e9c71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:13.439824 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684a9c90-4a61-49c0-a428-351db2e9c71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:13.455409 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1489b12-3d7b-4420-98a7-25e8496e146c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:13.682201 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1489b12-3d7b-4420-98a7-25e8496e146c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af9a7f61-9e74-4d62-8f44-7bb6c43f3d57', 'volume_name': 'volume-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:13.693827 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4ed7cc-1633-4cc2-a86b-46f6e8424a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:13.711624 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4ed7cc-1633-4cc2-a86b-46f6e8424a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:13.728340 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f038f90-951d-48ef-845d-a5037926ee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:13.729936 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Volume af9a7f61-9e74-4d62-8f44-7bb6c43f3d57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 21:10:13.731547 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Cloning af9a7f61-9e74-4d62-8f44-7bb6c43f3d57 from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 21:10:13.733004 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:10:13.752574 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:10:13.775995 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 10, 13, 762834)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:10:13.778657 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:10:13.779676 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 21:10:13.797582 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.045s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:10:13.798970 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 21:10:13.873483 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 10, 13, 862281)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:10:13.873919 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:10:13.874317 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 21:10:13.900339 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:14.068756 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] creating snapshot='volume-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:10:14.298783 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57.clone_snap' to 'volume-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:10:14.428005 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-924793d1-d72d-4741-88b8-0338aa27094e tempest-VolumesSnapshotTestJSON-1543447304 None] Create snapshot completed successfully Oct 22 21:10:14.542340 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:10:14.547812 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:10:14.548259 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:10:14.584441 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:10:14.585085 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Marking volume af9a7f61-9e74-4d62-8f44-7bb6c43f3d57 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:10:14.601866 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to af9a7f61-9e74-4d62-8f44-7bb6c43f3d57. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 21:10:14.602308 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Creating volume glance metadata for volume af9a7f61-9e74-4d62-8f44-7bb6c43f3d57 backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 21:10:14.807323 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f038f90-951d-48ef-845d-a5037926ee10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:14.821305 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204d88f9-9f8c-470d-bfc6-7ea83e997252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:14.846176 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Volume volume-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57 (af9a7f61-9e74-4d62-8f44-7bb6c43f3d57): created successfully Oct 22 21:10:14.854760 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204d88f9-9f8c-470d-bfc6-7ea83e997252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:14.869494 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Flow 'volume_create_manager' (097f7ab4-5873-4e0b-9fd2-67cf10a49881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:14.896121 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2cfc1ed8-5532-460a-a7f2-459e538bce83 tempest-TaggedBootDevicesTest-288730008 None] Created volume successfully. Oct 22 21:10:16.280753 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:10:16.351766 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Flow 'volume_create_manager' (65125663-2438-42a9-ac05-042de314f62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:16.366134 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f03125-e290-4057-b2e4-6819288215e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:16.413688 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f03125-e290-4057-b2e4-6819288215e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-32248965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d741aba9-6d17-41ea-aedf-8915327ec92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09185bfad7944b199a490305c22ffc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:10:16Z,use_quota=True,user_id='d69c1f0203b047eeb6a9fa0a215a63c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:16.418832 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb9dcce-7993-4446-8944-4a63b58b165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:16.428341 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb9dcce-7993-4446-8944-4a63b58b165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:16.446831 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93fa600-f7e2-450f-8064-bd3a0d0ea78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:16.453852 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93fa600-f7e2-450f-8064-bd3a0d0ea78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd741aba9-6d17-41ea-aedf-8915327ec92f', 'volume_name': 'volume-d741aba9-6d17-41ea-aedf-8915327ec92f', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:16.467042 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077b856b-64fb-4c5f-a0c9-55ce1b435f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:16.471090 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077b856b-64fb-4c5f-a0c9-55ce1b435f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:16.489256 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e56763d-fecf-4c94-89ce-6ae09194bf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:16.490722 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Volume d741aba9-6d17-41ea-aedf-8915327ec92f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d741aba9-6d17-41ea-aedf-8915327ec92f', 'volume_size': 1} Oct 22 21:10:16.491411 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] creating volume 'volume-d741aba9-6d17-41ea-aedf-8915327ec92f' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:10:16.496567 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:16.626227 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:10:16.687129 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:10:16.687544 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:10:16.698582 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e56763d-fecf-4c94-89ce-6ae09194bf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d741aba9-6d17-41ea-aedf-8915327ec92f', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:16.713352 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f951eb2e-db10-4a97-bd1f-a8b4547c4704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:16.803478 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (00a9d677-504d-4fb7-9128-2f82f4d9de37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:16.811086 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9e5ada-0eb2-47da-b7bb-0073b80f3ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:16.818241 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Volume volume-d741aba9-6d17-41ea-aedf-8915327ec92f (d741aba9-6d17-41ea-aedf-8915327ec92f): created successfully Oct 22 21:10:16.822505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f951eb2e-db10-4a97-bd1f-a8b4547c4704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:16.829899 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Flow 'volume_create_manager' (65125663-2438-42a9-ac05-042de314f62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:16.848273 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b8aa6d97-9b7f-40d4-86ae-bf08c908331f tempest-TaggedBootDevicesTest-288730008 None] Created volume successfully. Oct 22 21:10:16.861002 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9e5ada-0eb2-47da-b7bb-0073b80f3ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1513500665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=63d592ef-a809-4cc2-9093-1e9aeb589270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21349e14fb39496c9996d5af817b7f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:10:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0c1a46de-7917-463e-acf7-e569b7de1931,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:10:16Z,use_quota=True,user_id='7102f7b674934e19b3d4a001b563d0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:16.867918 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d94d507-f813-4619-b52b-156eacb33764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:16.872734 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d94d507-f813-4619-b52b-156eacb33764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:16.879046 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac40f87-0f7b-4cfb-a028-c516dfb83702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:16.884098 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac40f87-0f7b-4cfb-a028-c516dfb83702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '63d592ef-a809-4cc2-9093-1e9aeb589270', 'volume_name': 'volume-63d592ef-a809-4cc2-9093-1e9aeb589270', 'volume_size': 2, 'snapshot_id': '0c1a46de-7917-463e-acf7-e569b7de1931'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:16.893361 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22451b1-b54a-42b6-8600-06650442d58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:16.897965 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22451b1-b54a-42b6-8600-06650442d58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:16.907676 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654373da-488f-4190-aa7d-6bcc292ed4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:16.909262 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume 63d592ef-a809-4cc2-9093-1e9aeb589270: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-63d592ef-a809-4cc2-9093-1e9aeb589270', 'volume_size': 2, 'snapshot_id': '0c1a46de-7917-463e-acf7-e569b7de1931'} Oct 22 21:10:16.972349 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] cloning volumes/volume-06675d37-d2f3-4db8-aa05-8bf30bd310c3@snapshot-0c1a46de-7917-463e-acf7-e569b7de1931 to volume-63d592ef-a809-4cc2-9093-1e9aeb589270 {{(pid=131630) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}} Oct 22 21:10:16.977375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:17.138377 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:17.407737 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:10:17.409640 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:10:17.414986 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:17.690284 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654373da-488f-4190-aa7d-6bcc292ed4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d592ef-a809-4cc2-9093-1e9aeb589270', 'volume_size': 2, 'snapshot_id': '0c1a46de-7917-463e-acf7-e569b7de1931'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:17.694721 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04a3a48-3328-403e-9eec-2404626fe536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:17.737250 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume volume-63d592ef-a809-4cc2-9093-1e9aeb589270 (63d592ef-a809-4cc2-9093-1e9aeb589270): created successfully Oct 22 21:10:17.740821 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04a3a48-3328-403e-9eec-2404626fe536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:17.758000 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (00a9d677-504d-4fb7-9128-2f82f4d9de37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:17.798572 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5da2a4b6-f15a-450e-89f4-0278d2620f36 tempest-VolumesSnapshotTestJSON-1543447304 None] Created volume successfully. Oct 22 21:10:17.957317 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:10:18.015101 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Flow 'volume_create_manager' (d3f0395b-e879-4bdb-8205-f40b6d6f3fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:18.034563 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7b195f-0c74-4200-9ff7-f6cf2f8c1f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:18.061990 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7b195f-0c74-4200-9ff7-f6cf2f8c1f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-824166215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09185bfad7944b199a490305c22ffc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:10:18Z,use_quota=True,user_id='d69c1f0203b047eeb6a9fa0a215a63c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:18.069537 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05f7b7f-1ce4-4aec-8358-29dc42c7a38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:18.077904 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05f7b7f-1ce4-4aec-8358-29dc42c7a38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:18.085384 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbcd786-2d49-4631-9ba5-4a76db4b3192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:18.097592 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbcd786-2d49-4631-9ba5-4a76db4b3192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4', 'volume_name': 'volume-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:18.109188 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae12a3f-1c3c-421c-8967-77b44454dbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:18.119644 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae12a3f-1c3c-421c-8967-77b44454dbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:18.136501 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7069e44d-fb98-482d-a268-d4a1f4af6be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:18.138015 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Volume 0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4', 'volume_size': 1} Oct 22 21:10:18.139821 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] creating volume 'volume-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:10:18.140762 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:18.301064 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:10:18.301662 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:10:18.305361 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7069e44d-fb98-482d-a268-d4a1f4af6be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:18.315977 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f25a56-6fcd-4d0f-a205-1ac360ab38c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:18.345074 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Volume volume-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4 (0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4): created successfully Oct 22 21:10:18.351995 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f25a56-6fcd-4d0f-a205-1ac360ab38c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:18.360987 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Flow 'volume_create_manager' (d3f0395b-e879-4bdb-8205-f40b6d6f3fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:18.385109 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-eff97097-dcc4-424f-b4b9-d439831b9626 tempest-TaggedBootDevicesTest-288730008 None] Created volume successfully. Oct 22 21:10:18.730305 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7c7e0420-b5dd-4b88-99db-fdb631d24a3d tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-63d592ef-a809-4cc2-9093-1e9aeb589270-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:10:18.747788 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7c7e0420-b5dd-4b88-99db-fdb631d24a3d tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-63d592ef-a809-4cc2-9093-1e9aeb589270-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:10:18.833173 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7c7e0420-b5dd-4b88-99db-fdb631d24a3d tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:18.955634 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7c7e0420-b5dd-4b88-99db-fdb631d24a3d tempest-VolumesSnapshotTestJSON-1543447304 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:10:18.970032 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7c7e0420-b5dd-4b88-99db-fdb631d24a3d tempest-VolumesSnapshotTestJSON-1543447304 None] deleting rbd volume volume-63d592ef-a809-4cc2-9093-1e9aeb589270 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:10:19.509804 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-7c7e0420-b5dd-4b88-99db-fdb631d24a3d tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['67db1f36-5e70-47ba-9972-c1a096051b31', '5d9f5935-ada7-4c2b-ae8a-50a3ad2caa82', 'a1537e19-2ec3-4716-aa5f-cdb9b2396b50', '11c139fb-e8c0-4f20-8e67-b1eafd672975'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:19.710407 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7c7e0420-b5dd-4b88-99db-fdb631d24a3d tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:19.805358 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7c7e0420-b5dd-4b88-99db-fdb631d24a3d tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:19.917385 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-7c7e0420-b5dd-4b88-99db-fdb631d24a3d tempest-VolumesSnapshotTestJSON-1543447304 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:10:19.923151 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7c7e0420-b5dd-4b88-99db-fdb631d24a3d tempest-VolumesSnapshotTestJSON-1543447304 None] Deleted volume successfully. Oct 22 21:10:19.960036 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7c7e0420-b5dd-4b88-99db-fdb631d24a3d tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-63d592ef-a809-4cc2-9093-1e9aeb589270-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:10:20.589085 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:10:20.639596 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (f28b3799-0636-45d8-a149-f1101544cea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:20.656552 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a62044-ca3a-4aee-a3f1-9f1f253cb643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:20.679853 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a62044-ca3a-4aee-a3f1-9f1f253cb643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1029563084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b104ee6d-52a7-4cb5-8708-7195f1ea076b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21349e14fb39496c9996d5af817b7f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:10:21Z,use_quota=True,user_id='7102f7b674934e19b3d4a001b563d0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:20.685110 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb8f514-23a4-482a-9b27-87986f9364a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:20.693320 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb8f514-23a4-482a-9b27-87986f9364a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:20.698280 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf81e31-7d64-49ef-bf75-969a89fe49b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:20.703625 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf81e31-7d64-49ef-bf75-969a89fe49b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b104ee6d-52a7-4cb5-8708-7195f1ea076b', 'volume_name': 'volume-b104ee6d-52a7-4cb5-8708-7195f1ea076b', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:20.708342 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4bdb92-bf76-4562-b2c0-06cb734eadea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:20.712357 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4bdb92-bf76-4562-b2c0-06cb734eadea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:20.717128 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d25c941-10e6-48af-9f8c-7c6ad99722ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:20.718182 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Volume b104ee6d-52a7-4cb5-8708-7195f1ea076b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b104ee6d-52a7-4cb5-8708-7195f1ea076b', 'volume_size': 1} Oct 22 21:10:20.718574 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] creating volume 'volume-b104ee6d-52a7-4cb5-8708-7195f1ea076b' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:10:20.719498 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:20.883772 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:10:20.884423 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:10:20.888574 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d25c941-10e6-48af-9f8c-7c6ad99722ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b104ee6d-52a7-4cb5-8708-7195f1ea076b', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:20.897255 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e882f2a0-466f-4cc9-9da0-f74016757043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:20.904556 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=60,cinder:INSERT=12,cinder:UPDATE=22,cinder:DELETE=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:20.927642 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Volume volume-b104ee6d-52a7-4cb5-8708-7195f1ea076b (b104ee6d-52a7-4cb5-8708-7195f1ea076b): created successfully Oct 22 21:10:20.932784 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e882f2a0-466f-4cc9-9da0-f74016757043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:20.952160 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (f28b3799-0636-45d8-a149-f1101544cea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:20.979864 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-11bc99f0-47d9-4920-a46b-819db22a9c2c tempest-VolumesSnapshotTestJSON-1543447304 None] Created volume successfully. Oct 22 21:10:21.829495 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=69,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:21.841467 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-88fd927f-d945-455b-b743-7454a044647a tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:22.460379 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-88fd927f-d945-455b-b743-7454a044647a tempest-VolumesSnapshotTestJSON-1543447304 None] Create snapshot completed successfully Oct 22 21:10:23.726688 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:10:23.767389 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (8f1f6a66-0fd7-422e-83bc-557794359a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:23.795435 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37923a3-7875-44bc-ac55-dc943e2b5b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:23.828017 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37923a3-7875-44bc-ac55-dc943e2b5b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-184812424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f5b4a3af-4840-474e-b9c8-a387d55753fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21349e14fb39496c9996d5af817b7f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=06ce9ace-0017-4d3f-8f9a-ac32aecac10f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:10:24Z,use_quota=True,user_id='7102f7b674934e19b3d4a001b563d0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:23.836354 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13065b07-6743-4092-b228-f1d543c9d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:23.848594 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13065b07-6743-4092-b228-f1d543c9d539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:23.875962 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3141fdf4-c60d-4805-b637-b9c6b76cf3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:23.880025 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3141fdf4-c60d-4805-b637-b9c6b76cf3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f5b4a3af-4840-474e-b9c8-a387d55753fe', 'volume_name': 'volume-f5b4a3af-4840-474e-b9c8-a387d55753fe', 'volume_size': 1, 'snapshot_id': '06ce9ace-0017-4d3f-8f9a-ac32aecac10f'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:23.888033 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4676c358-3339-4acd-8d2d-99e5b1b2889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:23.896462 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4676c358-3339-4acd-8d2d-99e5b1b2889f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:23.908351 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e449ef-a8d0-4434-9a63-ee3e6f0c6d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:23.915723 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume f5b4a3af-4840-474e-b9c8-a387d55753fe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f5b4a3af-4840-474e-b9c8-a387d55753fe', 'volume_size': 1, 'snapshot_id': '06ce9ace-0017-4d3f-8f9a-ac32aecac10f'} Oct 22 21:10:23.940350 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] cloning volumes/volume-b104ee6d-52a7-4cb5-8708-7195f1ea076b@snapshot-06ce9ace-0017-4d3f-8f9a-ac32aecac10f to volume-f5b4a3af-4840-474e-b9c8-a387d55753fe {{(pid=131630) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}} Oct 22 21:10:23.943441 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:24.040226 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:24.244316 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:10:24.245155 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:10:24.299279 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e449ef-a8d0-4434-9a63-ee3e6f0c6d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b4a3af-4840-474e-b9c8-a387d55753fe', 'volume_size': 1, 'snapshot_id': '06ce9ace-0017-4d3f-8f9a-ac32aecac10f'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:24.310521 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4a9cf7-d86a-4c09-9714-12779cfab5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:24.332497 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume volume-f5b4a3af-4840-474e-b9c8-a387d55753fe (f5b4a3af-4840-474e-b9c8-a387d55753fe): created successfully Oct 22 21:10:24.356081 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4a9cf7-d86a-4c09-9714-12779cfab5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:24.366178 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Flow 'volume_create_manager' (8f1f6a66-0fd7-422e-83bc-557794359a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:24.390579 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-fd9c3ad0-3d59-421e-9f84-5c4d74d4bd74 tempest-VolumesSnapshotTestJSON-1543447304 None] Created volume successfully. Oct 22 21:10:25.055486 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4dda596b-f2f1-4ce1-a2a7-ae8469a850e5 tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-f5b4a3af-4840-474e-b9c8-a387d55753fe-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:10:25.069384 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4dda596b-f2f1-4ce1-a2a7-ae8469a850e5 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-f5b4a3af-4840-474e-b9c8-a387d55753fe-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:10:25.158598 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4dda596b-f2f1-4ce1-a2a7-ae8469a850e5 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:25.298202 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4dda596b-f2f1-4ce1-a2a7-ae8469a850e5 tempest-VolumesSnapshotTestJSON-1543447304 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:10:25.311422 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4dda596b-f2f1-4ce1-a2a7-ae8469a850e5 tempest-VolumesSnapshotTestJSON-1543447304 None] deleting rbd volume volume-f5b4a3af-4840-474e-b9c8-a387d55753fe {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:10:25.756929 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-4dda596b-f2f1-4ce1-a2a7-ae8469a850e5 tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['5b42aab6-bb63-4086-bcd7-0370f3258ac6', '2b7d2af7-2bbb-47b3-b215-3d5d3448b34d', '1be31e72-107b-435e-afb5-7fad6928552b', 'fbc17582-d4aa-4c00-aa63-653e0a976804'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:25.873571 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4dda596b-f2f1-4ce1-a2a7-ae8469a850e5 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:25.980720 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4dda596b-f2f1-4ce1-a2a7-ae8469a850e5 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:26.074361 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-4dda596b-f2f1-4ce1-a2a7-ae8469a850e5 tempest-VolumesSnapshotTestJSON-1543447304 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:10:26.084451 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4dda596b-f2f1-4ce1-a2a7-ae8469a850e5 tempest-VolumesSnapshotTestJSON-1543447304 None] Deleted volume successfully. Oct 22 21:10:26.138842 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4dda596b-f2f1-4ce1-a2a7-ae8469a850e5 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-f5b4a3af-4840-474e-b9c8-a387d55753fe-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:10:26.150127 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-6021c19d-0930-4e93-88b0-68f87e1119a4 req-a492131a-089d-4a17-b073-c4c301ef9193 tempest-TestVolumeBootPattern-1443368191 None] Terminate volume connection completed successfully. Oct 22 21:10:26.150833 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-6021c19d-0930-4e93-88b0-68f87e1119a4 req-a492131a-089d-4a17-b073-c4c301ef9193 tempest-TestVolumeBootPattern-1443368191 None] Deleting attachment 2a688b14-3a0b-498f-a671-d5490d06fd0e. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:10:26.377119 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-6d28fe87-d9ba-4bdf-97ec-7b5086d26069 tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-06ce9ace-0017-4d3f-8f9a-ac32aecac10f-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:10:26.391584 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-6d28fe87-d9ba-4bdf-97ec-7b5086d26069 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-06ce9ace-0017-4d3f-8f9a-ac32aecac10f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:10:26.393565 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6d28fe87-d9ba-4bdf-97ec-7b5086d26069 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:26.764426 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-6d28fe87-d9ba-4bdf-97ec-7b5086d26069 tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['6f939d6b-75f5-46ce-80ce-968edab1f17e', '79792597-03d0-490b-8d3a-62cc83290c94', 'd7e0cb30-f930-4762-88b4-318189d7f1fc', '4089e1cd-2a87-4485-a704-2685232cd8c4'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:26.852351 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6d28fe87-d9ba-4bdf-97ec-7b5086d26069 tempest-VolumesSnapshotTestJSON-1543447304 None] Delete snapshot completed successfully. Oct 22 21:10:26.879901 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-6d28fe87-d9ba-4bdf-97ec-7b5086d26069 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-06ce9ace-0017-4d3f-8f9a-ac32aecac10f-delete_snapshot" released by "delete_snapshot" :: held 0.488s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:10:27.558630 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-b104ee6d-52a7-4cb5-8708-7195f1ea076b-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:10:27.573458 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-b104ee6d-52a7-4cb5-8708-7195f1ea076b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:10:27.639492 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:27.734911 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:10:27.736008 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] Volume volume-b104ee6d-52a7-4cb5-8708-7195f1ea076b is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:10:27.744799 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] deleting rbd volume volume-b104ee6d-52a7-4cb5-8708-7195f1ea076b {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:10:28.199584 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['03184115-81ae-4ab0-96ba-9978f9eaea44', '1b5ab9ae-1f50-4c30-9601-a7a0ee99b267', '5a05688c-bab0-47fb-a201-c936658d6f95', 'fedae422-e2e6-4ca6-a5f2-6ac3ce888c36'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:28.312137 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:28.383574 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:28.455807 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:10:28.460224 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] Deleted volume successfully. Oct 22 21:10:28.480279 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d0f25e7b-97d7-4b0a-bf4b-d33b6053187e tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-b104ee6d-52a7-4cb5-8708-7195f1ea076b-delete_volume" released by "delete_volume" :: held 0.907s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:10:28.856135 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9893e78d-96f5-4950-bc03-a21932909dce tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-0c1a46de-7917-463e-acf7-e569b7de1931-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:10:28.876635 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9893e78d-96f5-4950-bc03-a21932909dce tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-0c1a46de-7917-463e-acf7-e569b7de1931-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:10:28.890508 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9893e78d-96f5-4950-bc03-a21932909dce tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:29.813747 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-9893e78d-96f5-4950-bc03-a21932909dce tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['f77783e7-63f5-41d6-af63-ef1a508f3021', 'a173f128-a16a-4952-bf3d-9ffe70e37f7b', 'f250e6ee-651d-402f-bd88-8ae7a36f2316', '402b7ec3-a584-45ab-aa68-ac3f4aad56b0'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:29.857087 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9893e78d-96f5-4950-bc03-a21932909dce tempest-VolumesSnapshotTestJSON-1543447304 None] Delete snapshot completed successfully. Oct 22 21:10:29.863856 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9893e78d-96f5-4950-bc03-a21932909dce tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-0c1a46de-7917-463e-acf7-e569b7de1931-delete_snapshot" released by "delete_snapshot" :: held 0.988s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:10:30.048015 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-06675d37-d2f3-4db8-aa05-8bf30bd310c3-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:10:30.073911 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-06675d37-d2f3-4db8-aa05-8bf30bd310c3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:10:30.094685 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=53,cinder:DELETE=2,cinder:UPDATE=33,cinder:INSERT=12 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:30.141699 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=66,cinder:UPDATE=28,cinder:INSERT=4,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:30.143878 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:30.204579 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:10:30.205013 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] Volume volume-06675d37-d2f3-4db8-aa05-8bf30bd310c3 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:10:30.213222 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] deleting rbd volume volume-06675d37-d2f3-4db8-aa05-8bf30bd310c3 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:10:30.528099 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['4c06fe93-652b-48ba-ab4d-7038065f33d3', '7d8882d6-afd7-4759-9e58-dc26be5183cc', '9c381956-50cd-45b4-9cc9-c939c5e16b2f', 'be532efb-1c80-4343-a84e-2414269ff3a8'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:30.584156 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:30.629488 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:30.680415 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:10:30.684427 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] Deleted volume successfully. Oct 22 21:10:30.708030 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-afc1a13a-824d-4e76-a510-b3914cb328b8 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-06675d37-d2f3-4db8-aa05-8bf30bd310c3-delete_volume" released by "delete_volume" :: held 0.634s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:10:31.663930 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:10:31.690253 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:10:31.738379 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:31.907769 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:10:31.928235 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] deleting rbd volume volume-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:10:32.306096 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:10:32.344245 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] deleting parent snapshot volume-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:10:33.338662 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['1d31bf9f-07c9-40d9-bcfd-c01cabf7050a', '9db58420-47f8-4444-ab04-24aebe01fd98', '08f9cd78-42e8-440a-aca4-803a72430022', 'eb7d304a-d6b1-46b6-9ebf-49fc115419a0'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:33.442025 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:33.519193 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:33.613609 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:10:33.617695 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] Deleted volume successfully. Oct 22 21:10:33.654385 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ba7fd168-7e6b-43c3-aa63-d22d1ddef4a1 tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-6d8909c5-5b5d-4a3a-9a9e-3e90bbd551b8-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:10:33.913554 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-019fe492-9541-4c22-9176-71f0a5330ffa req-560ef12e-687a-450d-b168-f4e1cbf14aba tempest-AttachVolumeTestJSON-485250435 None] Terminate volume connection completed successfully. Oct 22 21:10:33.914376 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-019fe492-9541-4c22-9176-71f0a5330ffa req-560ef12e-687a-450d-b168-f4e1cbf14aba tempest-AttachVolumeTestJSON-485250435 None] Deleting attachment aaa21c29-9a7f-48fc-9790-33024de31e8b. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:10:34.188659 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d5ec3e14-5114-4fcc-89c8-d8c931549f7c tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-397b6243-0159-4149-9401-bc1746c00726-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:10:34.222336 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d5ec3e14-5114-4fcc-89c8-d8c931549f7c tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-397b6243-0159-4149-9401-bc1746c00726-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:10:34.228093 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d5ec3e14-5114-4fcc-89c8-d8c931549f7c tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:34.955554 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-bc430bd4-90ce-44dd-9540-dca2397072f5 req-b6172398-4ea6-41d8-9e90-5a73530d7360 tempest-TestVolumeBootPattern-1443368191 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:10:35.436719 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-d5ec3e14-5114-4fcc-89c8-d8c931549f7c tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['4331f687-8752-4e18-9168-739f4416831d', 'd4eb108c-56f5-4d6b-8879-1bb56f7aafa5', 'ff02c651-7c13-40cc-8d10-2b145576959e', 'bcb9516c-8107-4940-a1a0-2de4227535ae'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:35.537836 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d5ec3e14-5114-4fcc-89c8-d8c931549f7c tempest-VolumesSnapshotTestJSON-1543447304 None] Delete snapshot completed successfully. Oct 22 21:10:35.544405 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d5ec3e14-5114-4fcc-89c8-d8c931549f7c tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-397b6243-0159-4149-9401-bc1746c00726-delete_snapshot" released by "delete_snapshot" :: held 1.325s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:10:36.101403 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-bc430bd4-90ce-44dd-9540-dca2397072f5 req-b6172398-4ea6-41d8-9e90-5a73530d7360 tempest-TestVolumeBootPattern-1443368191 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.146s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:10:36.103846 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-bc430bd4-90ce-44dd-9540-dca2397072f5 req-b6172398-4ea6-41d8-9e90-5a73530d7360 tempest-TestVolumeBootPattern-1443368191 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-636027aa-4bd0-4937-b625-4929d9464061', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '636027aa-4bd0-4937-b625-4929d9464061', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:10:36.134365 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-bc430bd4-90ce-44dd-9540-dca2397072f5 req-b6172398-4ea6-41d8-9e90-5a73530d7360 tempest-TestVolumeBootPattern-1443368191 None] Connection info returned from driver {'name': 'volumes/volume-636027aa-4bd0-4937-b625-4929d9464061', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '636027aa-4bd0-4937-b625-4929d9464061', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7751d639-0322-46de-9976-e6e824658d84'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:10:36.200776 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-bc430bd4-90ce-44dd-9540-dca2397072f5 req-b6172398-4ea6-41d8-9e90-5a73530d7360 tempest-TestVolumeBootPattern-1443368191 None] attachment_update completed successfully. Oct 22 21:10:36.432457 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] Acquiring lock "cinder-b9959707-0ed2-44c8-9e98-fa250b2609b9-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:10:36.457547 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-b9959707-0ed2-44c8-9e98-fa250b2609b9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:10:36.569020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:36.656804 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:10:36.657298 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] Volume volume-b9959707-0ed2-44c8-9e98-fa250b2609b9 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:10:36.671252 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] deleting rbd volume volume-b9959707-0ed2-44c8-9e98-fa250b2609b9 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:10:37.089964 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] Created reservations ['7c14a950-151a-436d-8473-8ae3929316a3', '9aad8eaf-de5e-45c8-b49e-f5f807320c29', '5b6f9d64-d313-4c36-926c-79edec16d954', '2993f2f4-1904-4a27-bed6-9d536ea1564e'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:37.186866 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:37.254778 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:37.311053 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:10:37.316044 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] Deleted volume successfully. Oct 22 21:10:37.337653 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7a2020a5-e42d-4965-a362-92769fc1e01e tempest-VolumesSnapshotTestJSON-1543447304 None] Lock "cinder-b9959707-0ed2-44c8-9e98-fa250b2609b9-delete_volume" released by "delete_volume" :: held 0.880s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:10:38.520029 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=61,cinder:INSERT=9,cinder:UPDATE=30 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:38.535390 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-563815f1-5889-4031-8d04-a5361ccdab4d req-92f0e9b1-2a99-41c1-aa38-e7cb795e75ba tempest-AttachVolumeShelveTestJSON-1454811106 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:10:38.912608 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-291c7711-0125-447c-b1d0-c9c7d2c35e1b tempest-BackendsCapabilitiesAdminTestsJSON-18232817 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:776e93ef-ad06-4c7f-a9fc-b5b546d962a8:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=131630) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}} Oct 22 21:10:38.975979 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0fa616f0-bae9-4246-938f-5e670fe2e8f2 tempest-BackendsCapabilitiesAdminTestsJSON-18232817 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:776e93ef-ad06-4c7f-a9fc-b5b546d962a8:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=131630) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}} Oct 22 21:10:39.762105 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-563815f1-5889-4031-8d04-a5361ccdab4d req-92f0e9b1-2a99-41c1-aa38-e7cb795e75ba tempest-AttachVolumeShelveTestJSON-1454811106 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.227s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:10:39.762834 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-563815f1-5889-4031-8d04-a5361ccdab4d req-92f0e9b1-2a99-41c1-aa38-e7cb795e75ba tempest-AttachVolumeShelveTestJSON-1454811106 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'c67610e1-af2e-402f-8cee-c3d2c0eb9bfd', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:10:39.810339 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=58,cinder:INSERT=7,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:39.820069 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-563815f1-5889-4031-8d04-a5361ccdab4d req-92f0e9b1-2a99-41c1-aa38-e7cb795e75ba tempest-AttachVolumeShelveTestJSON-1454811106 None] Connection info returned from driver {'name': 'volumes/volume-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c67610e1-af2e-402f-8cee-c3d2c0eb9bfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a0b6fb40-a69d-4fd3-b814-46105bff93c2'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:10:39.983961 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-563815f1-5889-4031-8d04-a5361ccdab4d req-92f0e9b1-2a99-41c1-aa38-e7cb795e75ba tempest-AttachVolumeShelveTestJSON-1454811106 None] attachment_update completed successfully. Oct 22 21:10:44.579523 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-fe995531-aa1f-429c-b683-99d16352189e tempest-GroupSnapshotsV319Test-517480959 None] Group tempest-GroupSnapshotsV319Test-Group-479156264: creating Oct 22 21:10:44.674090 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-fe995531-aa1f-429c-b683-99d16352189e tempest-GroupSnapshotsV319Test-517480959 None] Group tempest-GroupSnapshotsV319Test-Group-479156264: created successfully Oct 22 21:10:44.716726 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-fe995531-aa1f-429c-b683-99d16352189e tempest-GroupSnapshotsV319Test-517480959 None] Create group completed successfully. Oct 22 21:10:46.227472 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:10:46.261664 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Flow 'volume_create_manager' (4a8d66af-ef19-478a-b1aa-5956839ea20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:46.271990 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a9d981-3844-42e5-984c-b58d5dc0dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:46.297741 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a9d981-3844-42e5-984c-b58d5dc0dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-440874076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=496d343a-d1d7-4ab1-ab9b-b526d1575543,host='ncdv-master-1@ceph#ceph',id=e2709c02-faf4-436e-9f63-17f900b67cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7878c8302be34741abb75dd3633ad420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:10:46Z,use_quota=True,user_id='e94c8ae79a164744a6165d5e1882d866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe54119a-f792-4479-8f6a-93352748d36e),volume_type_id=fe54119a-f792-4479-8f6a-93352748d36e)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:46.303887 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5ee77a-4b7e-498d-b585-85ff5bb81cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:46.309720 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5ee77a-4b7e-498d-b585-85ff5bb81cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:46.319422 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4731d2ca-710b-4505-9932-e5f4c31a3e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:46.325845 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4731d2ca-710b-4505-9932-e5f4c31a3e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2709c02-faf4-436e-9f63-17f900b67cd5', 'volume_name': 'volume-e2709c02-faf4-436e-9f63-17f900b67cd5', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:46.333478 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f9a308-af54-4a54-8046-c4609d4b4df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:46.342526 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f9a308-af54-4a54-8046-c4609d4b4df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:46.350553 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9a9190-08fc-489c-b310-fe1ecce4834f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:46.351956 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Volume e2709c02-faf4-436e-9f63-17f900b67cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2709c02-faf4-436e-9f63-17f900b67cd5', 'volume_size': 1} Oct 22 21:10:46.352600 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] creating volume 'volume-e2709c02-faf4-436e-9f63-17f900b67cd5' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:10:46.354629 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:46.498787 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:10:46.499158 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:10:46.502886 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9a9190-08fc-489c-b310-fe1ecce4834f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2709c02-faf4-436e-9f63-17f900b67cd5', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:46.507437 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1e7619-1689-45af-886a-f57927187d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:10:46.530616 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Volume volume-e2709c02-faf4-436e-9f63-17f900b67cd5 (e2709c02-faf4-436e-9f63-17f900b67cd5): created successfully Oct 22 21:10:46.534109 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1e7619-1689-45af-886a-f57927187d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:10:46.539532 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Flow 'volume_create_manager' (4a8d66af-ef19-478a-b1aa-5956839ea20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:10:46.567598 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-16b3e4a9-949d-43a2-881e-f8ba5feb909b tempest-GroupSnapshotsV319Test-517480959 None] Created volume successfully. Oct 22 21:10:47.574651 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-3b2b1bb5-05e7-41cf-9d65-a0e0d19e8db2 tempest-GroupSnapshotsV319Test-517480959 None] GroupSnapshot 46409136-62e5-4e2b-971d-4c47d3da4c99: creating. Oct 22 21:10:47.627486 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3b2b1bb5-05e7-41cf-9d65-a0e0d19e8db2 tempest-GroupSnapshotsV319Test-517480959 None] Group snapshot 46409136-62e5-4e2b-971d-4c47d3da4c99: creating. {{(pid=131630) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}} Oct 22 21:10:47.648139 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3b2b1bb5-05e7-41cf-9d65-a0e0d19e8db2 tempest-GroupSnapshotsV319Test-517480959 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:48.862834 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-3b2b1bb5-05e7-41cf-9d65-a0e0d19e8db2 tempest-GroupSnapshotsV319Test-517480959 None] group_snapshot 46409136-62e5-4e2b-971d-4c47d3da4c99: created successfully Oct 22 21:10:50.681540 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-260952a3-df8b-4702-ba38-39fd8831640c tempest-GroupSnapshotsV319Test-517480959 None] group_snapshot 46409136-62e5-4e2b-971d-4c47d3da4c99: deleting Oct 22 21:10:50.738979 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-260952a3-df8b-4702-ba38-39fd8831640c tempest-GroupSnapshotsV319Test-517480959 None] group_snapshot 46409136-62e5-4e2b-971d-4c47d3da4c99: deleting {{(pid=131630) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}} Oct 22 21:10:50.790366 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-260952a3-df8b-4702-ba38-39fd8831640c tempest-GroupSnapshotsV319Test-517480959 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:51.838853 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-260952a3-df8b-4702-ba38-39fd8831640c tempest-GroupSnapshotsV319Test-517480959 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1854989837 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1854989837, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:10:51.848503 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-260952a3-df8b-4702-ba38-39fd8831640c tempest-GroupSnapshotsV319Test-517480959 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1854989837 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1854989837, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:10:51.897450 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-260952a3-df8b-4702-ba38-39fd8831640c tempest-GroupSnapshotsV319Test-517480959 None] Created reservations ['9069e7f8-dce4-4efa-818e-74e12a465619', '8ced025a-cc0b-4072-a2da-697e3230543c', '65e5cdab-837f-4eee-b818-1fa09c6ba69f', '7adb4758-d5ea-4409-99b8-c69c478acca2'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:52.006505 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-260952a3-df8b-4702-ba38-39fd8831640c tempest-GroupSnapshotsV319Test-517480959 None] group_snapshot 46409136-62e5-4e2b-971d-4c47d3da4c99: deleted successfully Oct 22 21:10:53.082605 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c2d9eb0a-1102-49b2-9f0a-fd8c129ebd4e tempest-GroupSnapshotsV319Test-517480959 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:53.223440 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c2d9eb0a-1102-49b2-9f0a-fd8c129ebd4e tempest-GroupSnapshotsV319Test-517480959 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:10:53.223899 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c2d9eb0a-1102-49b2-9f0a-fd8c129ebd4e tempest-GroupSnapshotsV319Test-517480959 None] Volume volume-e2709c02-faf4-436e-9f63-17f900b67cd5 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:10:53.229739 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c2d9eb0a-1102-49b2-9f0a-fd8c129ebd4e tempest-GroupSnapshotsV319Test-517480959 None] deleting rbd volume volume-e2709c02-faf4-436e-9f63-17f900b67cd5 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:10:53.256559 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-73358546-602d-4aae-aeeb-8dee7def107d req-bc3dca05-7be4-4d7b-bfe5-1a7ee71631a3 tempest-TaggedBootDevicesTest-288730008 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:10:53.757698 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-c2d9eb0a-1102-49b2-9f0a-fd8c129ebd4e tempest-GroupSnapshotsV319Test-517480959 None] Created reservations ['e1d71945-7bfb-4ef7-b397-71cb2c340910'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:53.803119 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-c2d9eb0a-1102-49b2-9f0a-fd8c129ebd4e tempest-GroupSnapshotsV319Test-517480959 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1854989837 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1854989837, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:10:53.842383 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-c2d9eb0a-1102-49b2-9f0a-fd8c129ebd4e tempest-GroupSnapshotsV319Test-517480959 None] Created reservations ['7e6f389b-796e-4fa6-b106-10b9dc8b9110', '5da6953d-f49a-4c91-875c-d299a1b12c03', 'd8667946-a9a0-44d0-99c4-455b48138861', '8f260b9d-1535-46db-baab-abd4ef1a416d'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:10:54.022224 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c2d9eb0a-1102-49b2-9f0a-fd8c129ebd4e tempest-GroupSnapshotsV319Test-517480959 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:54.094287 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c2d9eb0a-1102-49b2-9f0a-fd8c129ebd4e tempest-GroupSnapshotsV319Test-517480959 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:10:54.216526 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-c2d9eb0a-1102-49b2-9f0a-fd8c129ebd4e tempest-GroupSnapshotsV319Test-517480959 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:10:54.230379 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c2d9eb0a-1102-49b2-9f0a-fd8c129ebd4e tempest-GroupSnapshotsV319Test-517480959 None] Delete group completed successfully. Oct 22 21:10:55.690697 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-73358546-602d-4aae-aeeb-8dee7def107d req-bc3dca05-7be4-4d7b-bfe5-1a7ee71631a3 tempest-TaggedBootDevicesTest-288730008 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.434s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:10:55.694131 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-73358546-602d-4aae-aeeb-8dee7def107d req-bc3dca05-7be4-4d7b-bfe5-1a7ee71631a3 tempest-TaggedBootDevicesTest-288730008 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'af9a7f61-9e74-4d62-8f44-7bb6c43f3d57', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:10:55.767478 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-73358546-602d-4aae-aeeb-8dee7def107d req-bc3dca05-7be4-4d7b-bfe5-1a7ee71631a3 tempest-TaggedBootDevicesTest-288730008 None] Connection info returned from driver {'name': 'volumes/volume-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'af9a7f61-9e74-4d62-8f44-7bb6c43f3d57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '12343f0e-5af4-436b-a3bb-de6b0509690c'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:10:55.908234 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=72,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:55.917100 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-73358546-602d-4aae-aeeb-8dee7def107d req-bc3dca05-7be4-4d7b-bfe5-1a7ee71631a3 tempest-TaggedBootDevicesTest-288730008 None] attachment_update completed successfully. Oct 22 21:10:56.571250 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=69,cinder:UPDATE=28,cinder:INSERT=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:10:56.640731 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-73358546-602d-4aae-aeeb-8dee7def107d req-4b15eb44-f7ed-44d9-9c60-20cf6b48aa63 tempest-TaggedBootDevicesTest-288730008 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:10:58.482515 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-73358546-602d-4aae-aeeb-8dee7def107d req-4b15eb44-f7ed-44d9-9c60-20cf6b48aa63 tempest-TaggedBootDevicesTest-288730008 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.850s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:10:58.484470 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-73358546-602d-4aae-aeeb-8dee7def107d req-4b15eb44-f7ed-44d9-9c60-20cf6b48aa63 tempest-TaggedBootDevicesTest-288730008 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d741aba9-6d17-41ea-aedf-8915327ec92f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'd741aba9-6d17-41ea-aedf-8915327ec92f', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:10:58.590820 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-73358546-602d-4aae-aeeb-8dee7def107d req-4b15eb44-f7ed-44d9-9c60-20cf6b48aa63 tempest-TaggedBootDevicesTest-288730008 None] Connection info returned from driver {'name': 'volumes/volume-d741aba9-6d17-41ea-aedf-8915327ec92f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd741aba9-6d17-41ea-aedf-8915327ec92f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f1ccae1f-075a-4947-bb43-abea414ba9f7'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:10:58.712620 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-73358546-602d-4aae-aeeb-8dee7def107d req-4b15eb44-f7ed-44d9-9c60-20cf6b48aa63 tempest-TaggedBootDevicesTest-288730008 None] attachment_update completed successfully. Oct 22 21:10:59.376616 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-73358546-602d-4aae-aeeb-8dee7def107d req-cad9117e-65e9-4d0e-ada1-93b9fb1eeda8 tempest-TaggedBootDevicesTest-288730008 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:11:01.467173 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-73358546-602d-4aae-aeeb-8dee7def107d req-cad9117e-65e9-4d0e-ada1-93b9fb1eeda8 tempest-TaggedBootDevicesTest-288730008 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.090s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:11:01.468901 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-73358546-602d-4aae-aeeb-8dee7def107d req-cad9117e-65e9-4d0e-ada1-93b9fb1eeda8 tempest-TaggedBootDevicesTest-288730008 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:11:01.602319 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-73358546-602d-4aae-aeeb-8dee7def107d req-cad9117e-65e9-4d0e-ada1-93b9fb1eeda8 tempest-TaggedBootDevicesTest-288730008 None] Connection info returned from driver {'name': 'volumes/volume-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7563858f-60af-4998-a9cc-b018157c3591'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:11:01.793352 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-73358546-602d-4aae-aeeb-8dee7def107d req-cad9117e-65e9-4d0e-ada1-93b9fb1eeda8 tempest-TaggedBootDevicesTest-288730008 None] attachment_update completed successfully. Oct 22 21:11:11.779476 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=25,cinder:UPDATE=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:16.630084 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-b5b85e61-b391-402c-89eb-518f2845b74b req-cdb6678b-1933-407c-8f81-37d74b17ded5 tempest-ServerRescueNegativeTestJSON-610226422 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:11:17.808257 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-b5b85e61-b391-402c-89eb-518f2845b74b req-cdb6678b-1933-407c-8f81-37d74b17ded5 tempest-ServerRescueNegativeTestJSON-610226422 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.178s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:11:17.808832 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-b5b85e61-b391-402c-89eb-518f2845b74b req-cdb6678b-1933-407c-8f81-37d74b17ded5 tempest-ServerRescueNegativeTestJSON-610226422 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a27768b2-577b-4af0-8f2f-5c9897b3e528', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'a27768b2-577b-4af0-8f2f-5c9897b3e528', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:11:17.858091 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-b5b85e61-b391-402c-89eb-518f2845b74b req-cdb6678b-1933-407c-8f81-37d74b17ded5 tempest-ServerRescueNegativeTestJSON-610226422 None] Connection info returned from driver {'name': 'volumes/volume-a27768b2-577b-4af0-8f2f-5c9897b3e528', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a27768b2-577b-4af0-8f2f-5c9897b3e528', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e08e2809-4464-4741-a3e1-05fc33d08624'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:11:17.997984 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-b5b85e61-b391-402c-89eb-518f2845b74b req-cdb6678b-1933-407c-8f81-37d74b17ded5 tempest-ServerRescueNegativeTestJSON-610226422 None] attachment_update completed successfully. Oct 22 21:11:26.856568 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=36,cinder:UPDATE=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:29.558578 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:11:29.591620 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Flow 'volume_create_manager' (da20d885-9928-40fe-9e95-48111eaa52f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:11:29.591620 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ac3ed1-5c67-4286-8ee4-941f16cf58aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:29.602197 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ac3ed1-5c67-4286-8ee4-941f16cf58aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-3123726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7ca7bde1-d668-475f-931b-8e8869aebd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19639923f4f946cbad8c7705d09ab4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:11:30Z,use_quota=True,user_id='21e39b6cf7c84f5bbd0314e442bfa261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:29.607607 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec9efda-fa39-4e19-8cfa-02314fb3fcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:29.611477 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec9efda-fa39-4e19-8cfa-02314fb3fcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:29.616264 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e4c3d4-900f-4356-a8dc-1e3ece60f215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:29.620097 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e4c3d4-900f-4356-a8dc-1e3ece60f215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca7bde1-d668-475f-931b-8e8869aebd07', 'volume_name': 'volume-7ca7bde1-d668-475f-931b-8e8869aebd07', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:29.625127 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb578e9-48fe-48f2-807d-4224d3a4485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:29.629084 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb578e9-48fe-48f2-807d-4224d3a4485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:29.633812 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f570d4a-ccca-4d2c-b675-be91d9ba88fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:29.634887 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Volume 7ca7bde1-d668-475f-931b-8e8869aebd07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca7bde1-d668-475f-931b-8e8869aebd07', 'volume_size': 1} Oct 22 21:11:29.635324 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] creating volume 'volume-7ca7bde1-d668-475f-931b-8e8869aebd07' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:11:29.636347 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:29.700203 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:11:29.700586 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:11:29.704503 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f570d4a-ccca-4d2c-b675-be91d9ba88fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca7bde1-d668-475f-931b-8e8869aebd07', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:29.708933 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c77f06-d58b-4821-9228-ee6897e7ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:29.719475 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Volume volume-7ca7bde1-d668-475f-931b-8e8869aebd07 (7ca7bde1-d668-475f-931b-8e8869aebd07): created successfully Oct 22 21:11:29.723220 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c77f06-d58b-4821-9228-ee6897e7ca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:29.728981 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Flow 'volume_create_manager' (da20d885-9928-40fe-9e95-48111eaa52f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:11:29.738376 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5c5f2796-aefe-4f73-ad6c-d26fcc1cd694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Created volume successfully. Oct 22 21:11:30.517875 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:11:30.518887 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:30.616071 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:30.733594 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:11:31.014824 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-001fc7ee-9c45-4355-bb9f-d520628fe5e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:31.797815 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-001fc7ee-9c45-4355-bb9f-d520628fe5e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Create snapshot completed successfully Oct 22 21:11:32.469904 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7ef8bcb7-2bad-46f3-b8b0-851a693952fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Acquiring lock "cinder-dac94b4f-cb82-4b09-96b9-617a715647ec-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:11:32.481004 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7ef8bcb7-2bad-46f3-b8b0-851a693952fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Lock "cinder-dac94b4f-cb82-4b09-96b9-617a715647ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:11:32.482861 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7ef8bcb7-2bad-46f3-b8b0-851a693952fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:33.533476 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-7ef8bcb7-2bad-46f3-b8b0-851a693952fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Created reservations ['cb51792e-8658-4e34-a5e9-3a12b28bdb2a', '5f0a6c25-da65-412e-a187-80078aaef72d', '61ea54cf-f3be-4b81-8aea-aa1d3eb02adf', '3d246438-1da2-4cf0-a9bf-d9c4c9994b57'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:11:33.616011 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7ef8bcb7-2bad-46f3-b8b0-851a693952fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Delete snapshot completed successfully. Oct 22 21:11:33.623477 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7ef8bcb7-2bad-46f3-b8b0-851a693952fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Lock "cinder-dac94b4f-cb82-4b09-96b9-617a715647ec-delete_snapshot" released by "delete_snapshot" :: held 1.143s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:11:34.687284 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Acquiring lock "cinder-7ca7bde1-d668-475f-931b-8e8869aebd07-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:11:34.702715 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Lock "cinder-7ca7bde1-d668-475f-931b-8e8869aebd07-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:11:34.763813 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:34.860616 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:11:34.861603 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Volume volume-7ca7bde1-d668-475f-931b-8e8869aebd07 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:11:34.871931 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] deleting rbd volume volume-7ca7bde1-d668-475f-931b-8e8869aebd07 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:11:35.158854 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Created reservations ['8a146e7e-4c5a-491b-8e68-fbb8f5190ab0', 'd8b95b5b-cb91-4338-9c48-f661fe67be2e', '5acbceca-1991-4457-a715-6338c15b578a', 'e7f51c15-aa60-404c-8b38-fffed7c621b7'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:11:35.211520 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:35.240406 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:35.268927 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:11:35.274558 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Deleted volume successfully. Oct 22 21:11:35.289564 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a3e2510c-d156-4455-8425-09810c49fbbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1254093992 None] Lock "cinder-7ca7bde1-d668-475f-931b-8e8869aebd07-delete_volume" released by "delete_volume" :: held 0.587s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:11:42.141513 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=45,cinder:UPDATE=16,cinder:DELETE=3,cinder:INSERT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:42.174202 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:11:42.192994 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Flow 'volume_create_manager' (cea64a06-4547-407f-9f6a-dbb7ddbe501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:11:42.199248 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f648502-fbf8-4355-8c7d-be4bb93f3e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:42.215808 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f648502-fbf8-4355-8c7d-be4bb93f3e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1347644377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e7a962c2-61d1-4949-b981-665de195746e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311c868f57db4e6a81e87eaab3df0bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:11:42Z,use_quota=True,user_id='41b30a289158476c883d784ea0ad6021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:42.220964 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b346f60a-a688-4978-80ef-4596cb38e994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:42.224936 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b346f60a-a688-4978-80ef-4596cb38e994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:42.230227 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513b29e4-8255-42cf-aaf7-5b8e1488bcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:42.234144 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513b29e4-8255-42cf-aaf7-5b8e1488bcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a962c2-61d1-4949-b981-665de195746e', 'volume_name': 'volume-e7a962c2-61d1-4949-b981-665de195746e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:42.238740 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98c9017-81d4-45a8-89ab-973f98b9d239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:42.242441 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98c9017-81d4-45a8-89ab-973f98b9d239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:42.246977 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2966f313-35d2-49d6-adf0-3c155af67cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:42.248668 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Volume e7a962c2-61d1-4949-b981-665de195746e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a962c2-61d1-4949-b981-665de195746e', 'volume_size': 1} Oct 22 21:11:42.249834 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] creating volume 'volume-e7a962c2-61d1-4949-b981-665de195746e' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:11:42.250634 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:42.326890 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:11:42.327257 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:11:42.331046 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2966f313-35d2-49d6-adf0-3c155af67cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a962c2-61d1-4949-b981-665de195746e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:42.335418 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b635b35-3629-407f-ba32-6628e338d592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:42.348034 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Volume volume-e7a962c2-61d1-4949-b981-665de195746e (e7a962c2-61d1-4949-b981-665de195746e): created successfully Oct 22 21:11:42.352685 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b635b35-3629-407f-ba32-6628e338d592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:42.358314 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Flow 'volume_create_manager' (cea64a06-4547-407f-9f6a-dbb7ddbe501c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:11:42.369035 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-ffba5490-b66f-4fa8-894f-1cb3548b7db1 tempest-SnapshotMetadataTestJSON-1566171484 None] Created volume successfully. Oct 22 21:11:43.564251 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9ba36d7d-d88e-4633-8222-040e3d6f16d8 tempest-SnapshotMetadataTestJSON-1566171484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:44.484661 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9ba36d7d-d88e-4633-8222-040e3d6f16d8 tempest-SnapshotMetadataTestJSON-1566171484 None] Create snapshot completed successfully Oct 22 21:11:45.386938 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b548e2a3-a1bf-40b6-b119-c39da2685e52 tempest-SnapshotMetadataTestJSON-1566171484 None] Acquiring lock "cinder-5a4d2351-8fe2-48e9-b78e-1aed490a2d55-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:11:45.400549 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b548e2a3-a1bf-40b6-b119-c39da2685e52 tempest-SnapshotMetadataTestJSON-1566171484 None] Lock "cinder-5a4d2351-8fe2-48e9-b78e-1aed490a2d55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:11:45.402817 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b548e2a3-a1bf-40b6-b119-c39da2685e52 tempest-SnapshotMetadataTestJSON-1566171484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:46.548616 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-b548e2a3-a1bf-40b6-b119-c39da2685e52 tempest-SnapshotMetadataTestJSON-1566171484 None] Created reservations ['2b6e5311-235f-4ff5-b61d-b0650073560e', 'f5feb242-51e7-4d17-834f-07f46ac594de', 'a22333a1-1a05-4ba4-8c86-ce7dfb382e2d', '094e9944-7062-4891-9339-2edcdb20e77e'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:11:46.596321 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b548e2a3-a1bf-40b6-b119-c39da2685e52 tempest-SnapshotMetadataTestJSON-1566171484 None] Delete snapshot completed successfully. Oct 22 21:11:46.602001 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b548e2a3-a1bf-40b6-b119-c39da2685e52 tempest-SnapshotMetadataTestJSON-1566171484 None] Lock "cinder-5a4d2351-8fe2-48e9-b78e-1aed490a2d55-delete_snapshot" released by "delete_snapshot" :: held 1.203s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:11:47.567651 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] Acquiring lock "cinder-e7a962c2-61d1-4949-b981-665de195746e-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:11:47.598068 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] Lock "cinder-e7a962c2-61d1-4949-b981-665de195746e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:11:47.676957 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:47.779566 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:11:47.780203 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] Volume volume-e7a962c2-61d1-4949-b981-665de195746e is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:11:47.788200 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] deleting rbd volume volume-e7a962c2-61d1-4949-b981-665de195746e {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:11:48.099060 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] Created reservations ['13681c31-b7f1-4ea2-9f18-11a686ea3cab', '9a7b9bc3-ecca-4613-ae2c-073764948a5f', '89230cc7-39d1-4e96-a882-808f8b8af116', '5bd84da7-8813-487d-8a93-63c238c0ab66'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:11:48.139696 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=62,cinder:UPDATE=32,cinder:INSERT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:11:48.153403 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:48.233069 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:48.271418 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:11:48.275750 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] Deleted volume successfully. Oct 22 21:11:48.289067 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-6d412c60-b63c-49c5-a2be-4538c392fa20 tempest-SnapshotMetadataTestJSON-1566171484 None] Lock "cinder-e7a962c2-61d1-4949-b981-665de195746e-delete_volume" released by "delete_volume" :: held 0.691s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:11:48.530217 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 req-9fab8e81-9670-4cd0-8868-f3a6d719588e tempest-AttachVolumeShelveTestJSON-1454811106 None] Terminate volume connection completed successfully. Oct 22 21:11:48.530632 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-cd3f29ae-5ad7-445e-8c6d-4a6de4e91633 req-9fab8e81-9670-4cd0-8868-f3a6d719588e tempest-AttachVolumeShelveTestJSON-1454811106 None] Deleting attachment a0b6fb40-a69d-4fd3-b814-46105bff93c2. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:11:50.897199 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:11:50.923565 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Flow 'volume_create_manager' (377c0ba7-1ecb-4cde-98fa-38e37d2496f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:11:50.933373 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c046ba52-835b-457e-b188-99f120a40a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:50.961024 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c046ba52-835b-457e-b188-99f120a40a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-327781353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5162d2fb-43b2-4ede-bf56-2801a3ade09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0511d0a0ac846dbb842d37e17f16b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:11:51Z,use_quota=True,user_id='0130921ddb8b4c7681e7105d7c166d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:50.967011 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df6b95d-8e5b-4b7f-85d2-9ff395fa2830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:50.971996 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df6b95d-8e5b-4b7f-85d2-9ff395fa2830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:50.978359 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b58bbd-7885-4444-9043-2d601efc1972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:50.985277 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b58bbd-7885-4444-9043-2d601efc1972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5162d2fb-43b2-4ede-bf56-2801a3ade09e', 'volume_name': 'volume-5162d2fb-43b2-4ede-bf56-2801a3ade09e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:50.992231 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a96af37-4eff-4619-adbb-01a5e522cadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:50.997522 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a96af37-4eff-4619-adbb-01a5e522cadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:51.003124 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e8f2a2-f031-4e93-a685-9d4c5de32e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:51.005180 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Volume 5162d2fb-43b2-4ede-bf56-2801a3ade09e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5162d2fb-43b2-4ede-bf56-2801a3ade09e', 'volume_size': 1} Oct 22 21:11:51.005781 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] creating volume 'volume-5162d2fb-43b2-4ede-bf56-2801a3ade09e' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:11:51.007063 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:51.175514 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:11:51.176625 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:11:51.180450 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e8f2a2-f031-4e93-a685-9d4c5de32e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5162d2fb-43b2-4ede-bf56-2801a3ade09e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:51.190532 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7ea2f3-4f51-41dc-913e-8642f9237634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:51.217675 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Volume volume-5162d2fb-43b2-4ede-bf56-2801a3ade09e (5162d2fb-43b2-4ede-bf56-2801a3ade09e): created successfully Oct 22 21:11:51.223204 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7ea2f3-4f51-41dc-913e-8642f9237634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:51.229414 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Flow 'volume_create_manager' (377c0ba7-1ecb-4cde-98fa-38e37d2496f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:11:51.257241 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e65a90c6-dbbc-492b-bf99-ef67b063f2d1 tempest-VolumesMetadataTest-150607329 None] Created volume successfully. Oct 22 21:11:53.044886 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] Acquiring lock "cinder-5162d2fb-43b2-4ede-bf56-2801a3ade09e-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:11:53.076170 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] Lock "cinder-5162d2fb-43b2-4ede-bf56-2801a3ade09e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:11:53.157942 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:53.245847 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:11:53.246908 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] Volume volume-5162d2fb-43b2-4ede-bf56-2801a3ade09e is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:11:53.263817 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] deleting rbd volume volume-5162d2fb-43b2-4ede-bf56-2801a3ade09e {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:11:53.570523 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] Created reservations ['28228b68-48e8-4c13-a2ec-ab7cc4466605', '2749b3ab-dcda-4478-9f20-81a66e555203', 'f083152a-c36a-4f81-838d-5ba1994fdbd5', '1410402d-36b5-4fa8-9183-3af8df043964'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:11:53.647512 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:53.723717 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:53.793425 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:11:53.798424 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] Deleted volume successfully. Oct 22 21:11:53.823780 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e93e4dfb-5508-4587-ab63-95b00d38ce58 tempest-VolumesMetadataTest-150607329 None] Lock "cinder-5162d2fb-43b2-4ede-bf56-2801a3ade09e-delete_volume" released by "delete_volume" :: held 0.747s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:11:58.856906 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:11:58.883234 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Flow 'volume_create_manager' (c610376f-ce4f-4822-8a3d-25df0f9ee64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:11:58.891488 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc9d10c-4d51-488a-9765-5efb896c4c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:58.920984 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc9d10c-4d51-488a-9765-5efb896c4c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-613082803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5e4a0d22-c8a8-457d-92cd-2b7b7f03f748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44630c299ca84653b14ddaf206054aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:11:59Z,use_quota=True,user_id='4fd2e684941a408b968089289764861a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:58.943427 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00a3a56-32b2-46ed-9b6b-7d43833edff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:58.958225 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00a3a56-32b2-46ed-9b6b-7d43833edff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:58.973345 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abec579-e7ee-4df5-ba82-52a7d68f43e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:58.981505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abec579-e7ee-4df5-ba82-52a7d68f43e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e4a0d22-c8a8-457d-92cd-2b7b7f03f748', 'volume_name': 'volume-5e4a0d22-c8a8-457d-92cd-2b7b7f03f748', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:58.990783 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a59019-22ad-4e1d-876b-f5f750d96c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:58.995765 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a59019-22ad-4e1d-876b-f5f750d96c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:59.010719 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12659a0c-4f13-49ca-96e2-9b66c3191f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:59.017735 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Volume 5e4a0d22-c8a8-457d-92cd-2b7b7f03f748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e4a0d22-c8a8-457d-92cd-2b7b7f03f748', 'volume_size': 1} Oct 22 21:11:59.018701 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] creating volume 'volume-5e4a0d22-c8a8-457d-92cd-2b7b7f03f748' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:11:59.019979 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:11:59.161668 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:11:59.162124 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:11:59.167901 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12659a0c-4f13-49ca-96e2-9b66c3191f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e4a0d22-c8a8-457d-92cd-2b7b7f03f748', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:59.174803 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e93dca-9a79-4ae3-a100-104f704922c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:11:59.198545 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Volume volume-5e4a0d22-c8a8-457d-92cd-2b7b7f03f748 (5e4a0d22-c8a8-457d-92cd-2b7b7f03f748): created successfully Oct 22 21:11:59.203944 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e93dca-9a79-4ae3-a100-104f704922c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:11:59.217537 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Flow 'volume_create_manager' (c610376f-ce4f-4822-8a3d-25df0f9ee64d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:11:59.232895 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-1027661a-2021-46cd-b877-eef20bbde636 tempest-VolumesTransfersV355Test-80586313 None] Created volume successfully. Oct 22 21:12:00.823602 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8d36d855-3778-453b-b29e-947c1093a4d9 tempest-VolumesTransfersV355Test-260249033 None] Transfer volume completed successfully. Oct 22 21:12:01.927260 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] Acquiring lock "cinder-5e4a0d22-c8a8-457d-92cd-2b7b7f03f748-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:12:01.945618 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] Lock "cinder-5e4a0d22-c8a8-457d-92cd-2b7b7f03f748-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:12:02.015447 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:02.089045 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:12:02.089658 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] Volume volume-5e4a0d22-c8a8-457d-92cd-2b7b7f03f748 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:12:02.097768 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] deleting rbd volume volume-5e4a0d22-c8a8-457d-92cd-2b7b7f03f748 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:12:02.510754 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=62,cinder:UPDATE=25,cinder:DELETE=6,cinder:INSERT=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:02.524467 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] Created reservations ['b02a0734-2f3a-4008-9ee6-4f8f9a0d2310', '5d6c61dc-6371-482f-aeb6-09b7f3ee174f', 'e344cc4b-768d-4f45-ab3d-113ea288ac24', 'b69326b4-0d62-4495-a780-d5942557ab31'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:12:02.623075 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:02.744184 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:02.836621 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:12:02.856507 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] Deleted volume successfully. Oct 22 21:12:02.879378 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-bce0671e-6e7f-4685-91a0-251a979da4bf tempest-VolumesTransfersV355Test-1962513181 None] Lock "cinder-5e4a0d22-c8a8-457d-92cd-2b7b7f03f748-delete_volume" released by "delete_volume" :: held 0.934s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:12:03.892010 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:12:03.919240 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Flow 'volume_create_manager' (7f9799f7-9eb8-4bc5-8507-e8435f3f3f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:12:03.930161 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8397f1e9-51e8-459f-b33b-4466c5d5ccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:03.963209 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8397f1e9-51e8-459f-b33b-4466c5d5ccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1085355623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a551e29c-da63-4f6c-b8fb-c09d7a862c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44630c299ca84653b14ddaf206054aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:12:04Z,use_quota=True,user_id='4fd2e684941a408b968089289764861a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:03.982084 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf65b917-e9f5-4c57-9bbc-8fb79c427302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:04.007637 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf65b917-e9f5-4c57-9bbc-8fb79c427302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:04.007637 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccd3a5c-f2b0-4599-bb3c-b0ba52f7b611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:04.022136 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccd3a5c-f2b0-4599-bb3c-b0ba52f7b611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a551e29c-da63-4f6c-b8fb-c09d7a862c81', 'volume_name': 'volume-a551e29c-da63-4f6c-b8fb-c09d7a862c81', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:04.031065 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8927ec5-cbb7-4884-9792-31bd3ed1f1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:04.041227 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8927ec5-cbb7-4884-9792-31bd3ed1f1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:04.047311 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72a63ad-a872-4f64-a38b-dc4fcedfb9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:04.049016 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Volume a551e29c-da63-4f6c-b8fb-c09d7a862c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a551e29c-da63-4f6c-b8fb-c09d7a862c81', 'volume_size': 1} Oct 22 21:12:04.049594 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] creating volume 'volume-a551e29c-da63-4f6c-b8fb-c09d7a862c81' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:12:04.050541 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:04.169100 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:12:04.169706 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:12:04.173724 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72a63ad-a872-4f64-a38b-dc4fcedfb9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a551e29c-da63-4f6c-b8fb-c09d7a862c81', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:04.178918 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5c0bba-840e-4216-85c0-2754d07b9999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:04.207817 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Volume volume-a551e29c-da63-4f6c-b8fb-c09d7a862c81 (a551e29c-da63-4f6c-b8fb-c09d7a862c81): created successfully Oct 22 21:12:04.213384 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5c0bba-840e-4216-85c0-2754d07b9999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:04.234004 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Flow 'volume_create_manager' (7f9799f7-9eb8-4bc5-8507-e8435f3f3f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:12:04.255890 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-350cdd8c-3d34-4f78-b07d-800753308497 tempest-VolumesTransfersV355Test-80586313 None] Created volume successfully. Oct 22 21:12:05.283088 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] Acquiring lock "cinder-a551e29c-da63-4f6c-b8fb-c09d7a862c81-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:12:05.306667 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] Lock "cinder-a551e29c-da63-4f6c-b8fb-c09d7a862c81-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:12:05.369909 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:05.497225 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:12:05.497661 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] Volume volume-a551e29c-da63-4f6c-b8fb-c09d7a862c81 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:12:05.515170 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] deleting rbd volume volume-a551e29c-da63-4f6c-b8fb-c09d7a862c81 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:12:06.125819 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] Created reservations ['b97d9ef5-9ecf-44a6-940f-24e76c261f6a', '2068226c-c866-4763-9c46-a5aab64f00d0', '05d41050-8123-437b-90e0-ded419d61786', '89e7cb7a-3a2d-43e2-aee0-24794d873f1d'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:12:06.187721 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=51,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:06.199167 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:06.274290 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:06.339642 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:12:06.352191 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] Deleted volume successfully. Oct 22 21:12:06.373733 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-772220b8-b4aa-4cc6-bd21-2fc639470906 tempest-VolumesTransfersV355Test-1962513181 None] Lock "cinder-a551e29c-da63-4f6c-b8fb-c09d7a862c81-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:12:12.779062 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:12:12.809769 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Flow 'volume_create_manager' (07bd5fe4-43be-4a2a-92d2-3708f966b99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:12:12.821079 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32beeca3-365b-4857-a550-dbb64eb85a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:12.847241 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32beeca3-365b-4857-a550-dbb64eb85a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-721239955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=149fd703-9abc-4ec4-8ba0-0a0fa90a8053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08800d39acf54bd8a46819640b85a4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:12:13Z,use_quota=True,user_id='7c33754e45504433929b704339ec049d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:12.856550 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202edd19-eb42-4a92-87ce-fd66442765fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:12.865490 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202edd19-eb42-4a92-87ce-fd66442765fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:12.874803 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100e5b6c-e70d-453e-a8e9-9c80ee7a403d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:12.879594 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100e5b6c-e70d-453e-a8e9-9c80ee7a403d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149fd703-9abc-4ec4-8ba0-0a0fa90a8053', 'volume_name': 'volume-149fd703-9abc-4ec4-8ba0-0a0fa90a8053', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:12.885261 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c965ecc-cdc2-4b2b-98b0-2ff19709c268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:12.893235 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c965ecc-cdc2-4b2b-98b0-2ff19709c268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:12.908579 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947ece81-5cb4-4f61-b1d6-cc54b9c1c81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:12.913567 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Volume 149fd703-9abc-4ec4-8ba0-0a0fa90a8053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149fd703-9abc-4ec4-8ba0-0a0fa90a8053', 'volume_size': 1} Oct 22 21:12:12.914576 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] creating volume 'volume-149fd703-9abc-4ec4-8ba0-0a0fa90a8053' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:12:12.916474 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:13.128990 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:12:13.129781 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:12:13.133973 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947ece81-5cb4-4f61-b1d6-cc54b9c1c81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149fd703-9abc-4ec4-8ba0-0a0fa90a8053', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:13.138860 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d64809-39e2-4f7b-9cd4-5ec8a4f4b7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:13.161642 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Volume volume-149fd703-9abc-4ec4-8ba0-0a0fa90a8053 (149fd703-9abc-4ec4-8ba0-0a0fa90a8053): created successfully Oct 22 21:12:13.165959 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d64809-39e2-4f7b-9cd4-5ec8a4f4b7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:13.177996 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Flow 'volume_create_manager' (07bd5fe4-43be-4a2a-92d2-3708f966b99e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:12:13.198505 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-91c8f44c-9a2e-428a-80bb-2881ab65267d tempest-VolumesSnapshotListTestJSON-622295764 None] Created volume successfully. Oct 22 21:12:14.180282 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-37509f4e-422e-47f9-879a-c048cbff8a1b tempest-VolumesSnapshotListTestJSON-622295764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:14.576604 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-37509f4e-422e-47f9-879a-c048cbff8a1b tempest-VolumesSnapshotListTestJSON-622295764 None] Create snapshot completed successfully Oct 22 21:12:15.714291 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1c1128fb-a4a7-438e-ba71-50eedaea7f6c tempest-VolumesSnapshotListTestJSON-622295764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:16.678007 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-1c1128fb-a4a7-438e-ba71-50eedaea7f6c tempest-VolumesSnapshotListTestJSON-622295764 None] Create snapshot completed successfully Oct 22 21:12:18.107442 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6bc022b3-8861-41d8-8972-860dac6e826d tempest-VolumesSnapshotListTestJSON-622295764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:18.748558 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6bc022b3-8861-41d8-8972-860dac6e826d tempest-VolumesSnapshotListTestJSON-622295764 None] Create snapshot completed successfully Oct 22 21:12:18.794751 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-7f215c01-ed19-4eee-84f7-a27133401f15 req-26a69e9a-9cd7-4580-bac3-902052100f8a tempest-ServerRescueNegativeTestJSON-610226422 None] Terminate volume connection completed successfully. Oct 22 21:12:18.795777 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-7f215c01-ed19-4eee-84f7-a27133401f15 req-26a69e9a-9cd7-4580-bac3-902052100f8a tempest-ServerRescueNegativeTestJSON-610226422 None] Deleting attachment e08e2809-4464-4741-a3e1-05fc33d08624. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:12:20.297951 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f682605b-0389-496e-96d6-0f7e491bb673 tempest-VolumesSnapshotListTestJSON-622295764 None] Acquiring lock "cinder-04f8244b-8532-4fc5-9358-4d6589b72c72-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:12:20.335977 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f682605b-0389-496e-96d6-0f7e491bb673 tempest-VolumesSnapshotListTestJSON-622295764 None] Lock "cinder-04f8244b-8532-4fc5-9358-4d6589b72c72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:12:20.339394 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f682605b-0389-496e-96d6-0f7e491bb673 tempest-VolumesSnapshotListTestJSON-622295764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:20.719995 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-f682605b-0389-496e-96d6-0f7e491bb673 tempest-VolumesSnapshotListTestJSON-622295764 None] Created reservations ['c6cd7b71-3762-4335-a109-2427c277a24d', 'a238db3b-48a9-4014-840f-18e3a4f240bc', 'b9b69f79-2dba-42cd-92e9-13c1e89c99e6', 'ebf180a3-96e0-403c-9f3d-df4041e43afc'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:12:20.800547 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f682605b-0389-496e-96d6-0f7e491bb673 tempest-VolumesSnapshotListTestJSON-622295764 None] Delete snapshot completed successfully. Oct 22 21:12:20.806328 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f682605b-0389-496e-96d6-0f7e491bb673 tempest-VolumesSnapshotListTestJSON-622295764 None] Lock "cinder-04f8244b-8532-4fc5-9358-4d6589b72c72-delete_snapshot" released by "delete_snapshot" :: held 0.471s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:12:21.505196 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5a3497a5-ae05-47b2-9a71-2c4936db7d90 tempest-VolumesSnapshotListTestJSON-622295764 None] Acquiring lock "cinder-e06f317a-3fb8-4e6a-a589-3dd14c1d645f-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:12:21.537728 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5a3497a5-ae05-47b2-9a71-2c4936db7d90 tempest-VolumesSnapshotListTestJSON-622295764 None] Lock "cinder-e06f317a-3fb8-4e6a-a589-3dd14c1d645f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:12:21.543903 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5a3497a5-ae05-47b2-9a71-2c4936db7d90 tempest-VolumesSnapshotListTestJSON-622295764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:22.797813 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-5a3497a5-ae05-47b2-9a71-2c4936db7d90 tempest-VolumesSnapshotListTestJSON-622295764 None] Created reservations ['96f929c1-58ca-4ed1-869b-6ff63ba9ba1a', 'a1de072d-35e3-4925-9aa3-504d3d58a755', 'ba7c7068-adfc-4a6d-b0ac-1409fc64b1b9', 'a42ff07c-73c6-4a4c-b83e-5e8829f0f097'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:12:22.880906 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=61,cinder:UPDATE=31,cinder:DELETE=4,cinder:INSERT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:22.895244 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5a3497a5-ae05-47b2-9a71-2c4936db7d90 tempest-VolumesSnapshotListTestJSON-622295764 None] Delete snapshot completed successfully. Oct 22 21:12:22.902469 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5a3497a5-ae05-47b2-9a71-2c4936db7d90 tempest-VolumesSnapshotListTestJSON-622295764 None] Lock "cinder-e06f317a-3fb8-4e6a-a589-3dd14c1d645f-delete_snapshot" released by "delete_snapshot" :: held 1.365s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:12:23.741642 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-87bacd5c-f7a1-42e0-a3cd-56d930c34497 tempest-VolumesSnapshotListTestJSON-622295764 None] Acquiring lock "cinder-0d81b078-4a92-4489-aecb-042dd1783c12-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:12:23.752787 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-87bacd5c-f7a1-42e0-a3cd-56d930c34497 tempest-VolumesSnapshotListTestJSON-622295764 None] Lock "cinder-0d81b078-4a92-4489-aecb-042dd1783c12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:12:23.755025 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-87bacd5c-f7a1-42e0-a3cd-56d930c34497 tempest-VolumesSnapshotListTestJSON-622295764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:24.819162 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-87bacd5c-f7a1-42e0-a3cd-56d930c34497 tempest-VolumesSnapshotListTestJSON-622295764 None] Created reservations ['602e708d-7560-48f9-98bc-a163bae92e82', '24168cbb-bf7f-4170-bd6e-41270ab90b1e', '462aa192-41b0-4061-baf2-949d7c8e3695', 'c4520f3f-57c3-4e9d-8beb-a4554cab2938'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:12:24.875709 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-87bacd5c-f7a1-42e0-a3cd-56d930c34497 tempest-VolumesSnapshotListTestJSON-622295764 None] Delete snapshot completed successfully. Oct 22 21:12:24.881250 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-87bacd5c-f7a1-42e0-a3cd-56d930c34497 tempest-VolumesSnapshotListTestJSON-622295764 None] Lock "cinder-0d81b078-4a92-4489-aecb-042dd1783c12-delete_snapshot" released by "delete_snapshot" :: held 1.128s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:12:25.945607 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] Acquiring lock "cinder-149fd703-9abc-4ec4-8ba0-0a0fa90a8053-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:12:25.978435 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] Lock "cinder-149fd703-9abc-4ec4-8ba0-0a0fa90a8053-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:12:26.063514 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:26.175167 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:12:26.176084 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] Volume volume-149fd703-9abc-4ec4-8ba0-0a0fa90a8053 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:12:26.187037 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] deleting rbd volume volume-149fd703-9abc-4ec4-8ba0-0a0fa90a8053 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:12:26.605932 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] Created reservations ['7724df23-6427-4f34-b7bb-df829806bdf4', '678d6731-5470-4897-bfea-b4c1a06f9188', '32dae619-5211-46d4-adff-edf902223bd3', 'ba97db67-2e8b-467a-b485-ad405c69636f'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:12:26.711324 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:26.777292 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:26.885283 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:12:26.901622 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] Deleted volume successfully. Oct 22 21:12:26.944717 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9961576b-cf4a-4984-9d02-74bc5a51c053 tempest-VolumesSnapshotListTestJSON-622295764 None] Lock "cinder-149fd703-9abc-4ec4-8ba0-0a0fa90a8053-delete_volume" released by "delete_volume" :: held 0.967s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:12:29.784446 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] Acquiring lock "cinder-a27768b2-577b-4af0-8f2f-5c9897b3e528-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:12:29.799946 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] Lock "cinder-a27768b2-577b-4af0-8f2f-5c9897b3e528-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:12:29.834486 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=59,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:29.836308 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:29.880128 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:12:29.880612 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] Volume volume-a27768b2-577b-4af0-8f2f-5c9897b3e528 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:12:29.888043 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] deleting rbd volume volume-a27768b2-577b-4af0-8f2f-5c9897b3e528 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:12:30.209906 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] Created reservations ['efa805be-ad03-4dc3-96ea-6a54f10194d8', '595f500d-42d0-415e-95de-363e45b6b6e8', 'a2f226fb-9737-4328-a063-b8be2d059b5f', '01bd1f9c-903d-435e-a751-676b87f5621e'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:12:30.268187 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:30.302179 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:30.356287 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:12:30.367210 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] Deleted volume successfully. Oct 22 21:12:30.389698 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4e5499f6-0f11-489b-ad5a-c58cbde53767 tempest-ServerRescueNegativeTestJSON-610226422 None] Lock "cinder-a27768b2-577b-4af0-8f2f-5c9897b3e528-delete_volume" released by "delete_volume" :: held 0.590s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:12:30.514266 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:12:30.515003 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:30.547754 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:30.581510 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:12:30.969877 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] Acquiring lock "cinder-49bf8882-4d00-468f-a20f-effc54a1c736-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:12:30.982973 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] Lock "cinder-49bf8882-4d00-468f-a20f-effc54a1c736-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:12:31.047101 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:31.094594 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:12:31.094939 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] Volume volume-49bf8882-4d00-468f-a20f-effc54a1c736 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:12:31.102765 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] deleting rbd volume volume-49bf8882-4d00-468f-a20f-effc54a1c736 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:12:31.360264 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] Created reservations ['db3cae09-23f3-4075-9167-7122c57ceb08', '5049aea3-8b07-4cc3-8e39-83fff49fecfe', '60d397e2-ee0a-4092-8540-f2770159ef40', '7ad032da-9c5d-4601-9d73-05191d7f2d94'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:12:31.417674 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:31.469131 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:31.507958 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:12:31.513371 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] Deleted volume successfully. Oct 22 21:12:31.529333 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f3d73d49-c9a5-416c-8c59-fe9531d51228 tempest-ServerRescueNegativeTestJSON-610226422 None] Lock "cinder-49bf8882-4d00-468f-a20f-effc54a1c736-delete_volume" released by "delete_volume" :: held 0.546s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:12:41.519994 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=48,cinder:INSERT=9,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:49.918249 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:12:49.982020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Flow 'volume_create_manager' (c74416fe-7c66-4460-89d8-9c18b29d70c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:12:49.995562 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa064ff0-1190-483f-9d06-3fd2a0fe33a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:50.020280 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa064ff0-1190-483f-9d06-3fd2a0fe33a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1325310646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8dbcb5d7-299f-4798-9566-1f5ec03e2c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba71430f3dc046f68faab18103ba9007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:12:50Z,use_quota=True,user_id='cb4464172f8d43a986f7de04724a8d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:50.030144 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e260af-dec3-4bc8-a167-9f5157a437dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:50.038349 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e260af-dec3-4bc8-a167-9f5157a437dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:50.051213 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a01345-134e-4642-b8fc-a2c095de6ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:50.171281 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a01345-134e-4642-b8fc-a2c095de6ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8dbcb5d7-299f-4798-9566-1f5ec03e2c40', 'volume_name': 'volume-8dbcb5d7-299f-4798-9566-1f5ec03e2c40', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:50.177335 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7f892e-0507-442d-9aab-ceda79dfb55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:50.183377 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7f892e-0507-442d-9aab-ceda79dfb55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:50.188768 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7497cf-b02d-42ec-bbda-ad41d1dfda90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:50.190415 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Volume 8dbcb5d7-299f-4798-9566-1f5ec03e2c40: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8dbcb5d7-299f-4798-9566-1f5ec03e2c40', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 21:12:50.191203 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Cloning 8dbcb5d7-299f-4798-9566-1f5ec03e2c40 from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 21:12:50.192178 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:12:50.202862 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:12:50.221923 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 12, 50, 208466)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:12:50.222536 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:12:50.223137 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 21:12:50.230788 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.028s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:12:50.232494 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 21:12:50.241051 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 12, 50, 237660)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:12:50.241881 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:12:50.242477 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 21:12:50.257508 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:50.357176 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] creating snapshot='volume-8dbcb5d7-299f-4798-9566-1f5ec03e2c40.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:12:50.735228 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-8dbcb5d7-299f-4798-9566-1f5ec03e2c40.clone_snap' to 'volume-8dbcb5d7-299f-4798-9566-1f5ec03e2c40' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:12:50.944729 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:12:50.945926 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:12:50.946507 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:12:50.968089 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:12:50.968957 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Marking volume 8dbcb5d7-299f-4798-9566-1f5ec03e2c40 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:12:50.988405 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to 8dbcb5d7-299f-4798-9566-1f5ec03e2c40. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 21:12:50.989390 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Creating volume glance metadata for volume 8dbcb5d7-299f-4798-9566-1f5ec03e2c40 backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 21:12:51.078499 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7497cf-b02d-42ec-bbda-ad41d1dfda90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dbcb5d7-299f-4798-9566-1f5ec03e2c40', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:51.083883 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0815d5d1-4ba0-4569-ae35-4a31cf0a34ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:51.102020 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Volume volume-8dbcb5d7-299f-4798-9566-1f5ec03e2c40 (8dbcb5d7-299f-4798-9566-1f5ec03e2c40): created successfully Oct 22 21:12:51.107078 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0815d5d1-4ba0-4569-ae35-4a31cf0a34ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:51.116429 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Flow 'volume_create_manager' (c74416fe-7c66-4460-89d8-9c18b29d70c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:12:51.132362 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-16844f57-4e50-4a57-8e48-bc0f94c125f1 tempest-TestVolumeBackupRestore-2071196610 None] Created volume successfully. Oct 22 21:12:52.340517 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-11ecfe83-8f3f-4bd8-a6f0-0e60d1e50794 tempest-TestVolumeBackupRestore-2071196610 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-22T21:12:52Z,data_timestamp=2022-10-22T21:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=e7f7323c-d356-444c-83ba-5091b8e9831a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='ba71430f3dc046f68faab18103ba9007',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='cb4464172f8d43a986f7de04724a8d52',volume_id=8dbcb5d7-299f-4798-9566-1f5ec03e2c40) Oct 22 21:12:52.343076 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.backup.rpcapi [None req-11ecfe83-8f3f-4bd8-a6f0-0e60d1e50794 tempest-TestVolumeBackupRestore-2071196610 None] continue_backup in rpcapi backup_id e7f7323c-d356-444c-83ba-5091b8e9831a {{(pid=131630) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Oct 22 21:12:52.492817 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-11ecfe83-8f3f-4bd8-a6f0-0e60d1e50794 tempest-TestVolumeBackupRestore-2071196610 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:12:53.458384 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-11ecfe83-8f3f-4bd8-a6f0-0e60d1e50794 tempest-TestVolumeBackupRestore-2071196610 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.965s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:12:53.460327 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-11ecfe83-8f3f-4bd8-a6f0-0e60d1e50794 tempest-TestVolumeBackupRestore-2071196610 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8dbcb5d7-299f-4798-9566-1f5ec03e2c40', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '8dbcb5d7-299f-4798-9566-1f5ec03e2c40', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:12:53.491373 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-11ecfe83-8f3f-4bd8-a6f0-0e60d1e50794 tempest-TestVolumeBackupRestore-2071196610 None] Initialize volume connection completed successfully. Oct 22 21:12:55.999849 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d3b0ca2f-7cb5-4698-8e0d-ccf4266b6739 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:12:57.125103 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=62,cinder:INSERT=16,cinder:UPDATE=22 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:12:57.162145 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d3b0ca2f-7cb5-4698-8e0d-ccf4266b6739 tempest-TestVolumeBootPattern-1443368191 None] Create snapshot completed successfully Oct 22 21:12:59.196229 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:12:59.352059 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (1ef72fe1-6643-420d-9e67-dd61acfa12fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:12:59.372808 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c82a5b9-2a52-45ff-88f5-38e1dcb5ef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:59.427033 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c82a5b9-2a52-45ff-88f5-38e1dcb5ef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1746895685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2b053a3-6082-4ecb-aa86-9bc2e5608d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a42c3ecf474883ac652fcc8c01c9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=023fa692-c7d4-402a-9884-7be43ebed8c6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:12:59Z,use_quota=True,user_id='7e3820b31a424c3a9216a6ef91fcb285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:59.436278 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506b14ed-0a8d-445b-88e5-bb88c5b9a1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:59.444135 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506b14ed-0a8d-445b-88e5-bb88c5b9a1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:59.485164 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbd9087-8248-40a2-bc04-d2d6c82dfbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:59.504305 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbd9087-8248-40a2-bc04-d2d6c82dfbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2b053a3-6082-4ecb-aa86-9bc2e5608d19', 'volume_name': 'volume-b2b053a3-6082-4ecb-aa86-9bc2e5608d19', 'volume_size': 1, 'snapshot_id': '023fa692-c7d4-402a-9884-7be43ebed8c6'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:59.516847 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea397a6-00bb-4628-abb2-01e413ecb391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:59.537118 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea397a6-00bb-4628-abb2-01e413ecb391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:12:59.553766 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4d36d4-dee6-4bc1-b723-e0c5aa08572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:12:59.557031 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Volume b2b053a3-6082-4ecb-aa86-9bc2e5608d19: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2b053a3-6082-4ecb-aa86-9bc2e5608d19', 'volume_size': 1, 'snapshot_id': '023fa692-c7d4-402a-9884-7be43ebed8c6'} Oct 22 21:12:59.609712 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] cloning volumes/volume-636027aa-4bd0-4937-b625-4929d9464061@snapshot-023fa692-c7d4-402a-9884-7be43ebed8c6 to volume-b2b053a3-6082-4ecb-aa86-9bc2e5608d19 {{(pid=131630) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}} Oct 22 21:12:59.610471 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:00.062276 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:00.187219 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:13:00.209480 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Flow 'volume_create_manager' (b1007b22-fd08-4327-945b-33473c382c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:00.218191 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ea3df1-0803-488a-b850-3dbe92961dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:00.238513 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ea3df1-0803-488a-b850-3dbe92961dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2122004523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd8c9d9a-c8b6-4103-804b-d25128f1cb17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f28cafad8942518b882192687b8b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:13:00Z,use_quota=True,user_id='eb24324c9c174645a3e9bc8bb913afe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:00.244626 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecd62d0-0428-465f-becc-1a290eef5cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:00.249288 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecd62d0-0428-465f-becc-1a290eef5cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:00.254870 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f681764-9621-4c09-b0ba-62762709a408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:00.258820 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f681764-9621-4c09-b0ba-62762709a408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8c9d9a-c8b6-4103-804b-d25128f1cb17', 'volume_name': 'volume-cd8c9d9a-c8b6-4103-804b-d25128f1cb17', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:00.264036 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3e21ed-1e5b-40af-8390-0e5d48ebb4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:00.268387 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3e21ed-1e5b-40af-8390-0e5d48ebb4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:00.272946 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420d74fa-dc98-4e41-b65d-e6b39307965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:00.284526 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Volume cd8c9d9a-c8b6-4103-804b-d25128f1cb17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8c9d9a-c8b6-4103-804b-d25128f1cb17', 'volume_size': 1} Oct 22 21:13:00.285376 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] creating volume 'volume-cd8c9d9a-c8b6-4103-804b-d25128f1cb17' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:13:00.286228 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:00.763293 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:13:00.765516 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:13:00.770011 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420d74fa-dc98-4e41-b65d-e6b39307965a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8c9d9a-c8b6-4103-804b-d25128f1cb17', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:00.775062 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954319df-4463-4844-9a69-eb422afc4d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:00.800495 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Volume volume-cd8c9d9a-c8b6-4103-804b-d25128f1cb17 (cd8c9d9a-c8b6-4103-804b-d25128f1cb17): created successfully Oct 22 21:13:00.811647 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954319df-4463-4844-9a69-eb422afc4d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:00.831946 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Flow 'volume_create_manager' (b1007b22-fd08-4327-945b-33473c382c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:00.861657 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:13:00.863181 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:13:00.876948 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9c67dea9-b3ef-4dfc-8ff3-24deab26e7c6 tempest-AttachVolumeShelveTestJSON-1454811106 None] Created volume successfully. Oct 22 21:13:00.897541 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Marking volume b2b053a3-6082-4ecb-aa86-9bc2e5608d19 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:13:00.918475 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Copying metadata from snapshot 023fa692-c7d4-402a-9884-7be43ebed8c6 to b2b053a3-6082-4ecb-aa86-9bc2e5608d19. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Oct 22 21:13:00.968481 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4d36d4-dee6-4bc1-b723-e0c5aa08572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b053a3-6082-4ecb-aa86-9bc2e5608d19', 'volume_size': 1, 'snapshot_id': '023fa692-c7d4-402a-9884-7be43ebed8c6'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:00.987946 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a082e8f-4eeb-468d-8dbd-f325f69c5b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:01.013746 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Volume volume-b2b053a3-6082-4ecb-aa86-9bc2e5608d19 (b2b053a3-6082-4ecb-aa86-9bc2e5608d19): created successfully Oct 22 21:13:01.020546 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a082e8f-4eeb-468d-8dbd-f325f69c5b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:01.026504 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Flow 'volume_create_manager' (1ef72fe1-6643-420d-9e67-dd61acfa12fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:01.054567 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e93d3b53-1d20-4cb1-af92-819f019305fa tempest-TestVolumeBootPattern-1443368191 None] Created volume successfully. Oct 22 21:13:02.542438 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-11ecfe83-8f3f-4bd8-a6f0-0e60d1e50794 tempest-TestVolumeBackupRestore-2071196610 None] Terminate volume connection completed successfully. Oct 22 21:13:02.584600 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-11ecfe83-8f3f-4bd8-a6f0-0e60d1e50794 tempest-TestVolumeBackupRestore-2071196610 None] Remove volume export completed successfully. Oct 22 21:13:03.703249 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:13:03.754090 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Flow 'volume_create_manager' (013d54d8-afa8-4635-af20-63d164be76d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:03.774593 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5911c4-1398-46da-a7ab-aa236be92e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:03.813739 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5911c4-1398-46da-a7ab-aa236be92e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:13:03Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_e7f7323c-d356-444c-83ba-5091b8e9831a',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4678044e-7418-4ed6-afa9-88f7a689bd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba71430f3dc046f68faab18103ba9007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:13:04Z,use_quota=True,user_id='cb4464172f8d43a986f7de04724a8d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:03.827532 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844a351f-fa68-4d3e-b36a-cbe08df0f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:03.837020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844a351f-fa68-4d3e-b36a-cbe08df0f987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:03.842901 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b023b5-093f-40d1-b278-3c438c3beb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:03.848314 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b023b5-093f-40d1-b278-3c438c3beb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4678044e-7418-4ed6-afa9-88f7a689bd0c', 'volume_name': 'volume-4678044e-7418-4ed6-afa9-88f7a689bd0c', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:03.855023 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400a5dca-8499-48fa-a60a-f37bbb0afb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:03.858931 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400a5dca-8499-48fa-a60a-f37bbb0afb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:03.865352 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bb3979-597a-4339-977e-86810ab8bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:03.866516 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Volume 4678044e-7418-4ed6-afa9-88f7a689bd0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4678044e-7418-4ed6-afa9-88f7a689bd0c', 'volume_size': 1} Oct 22 21:13:03.866977 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] creating volume 'volume-4678044e-7418-4ed6-afa9-88f7a689bd0c' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:13:03.867720 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:04.020609 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:13:04.021090 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:13:04.027729 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bb3979-597a-4339-977e-86810ab8bd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4678044e-7418-4ed6-afa9-88f7a689bd0c', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:04.039953 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3f0686-fbff-40bb-90ef-1e760317df0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:04.063671 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Volume volume-4678044e-7418-4ed6-afa9-88f7a689bd0c (4678044e-7418-4ed6-afa9-88f7a689bd0c): created successfully Oct 22 21:13:04.071817 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3f0686-fbff-40bb-90ef-1e760317df0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:04.080771 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Flow 'volume_create_manager' (013d54d8-afa8-4635-af20-63d164be76d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:04.109414 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Created volume successfully. Oct 22 21:13:04.690400 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:13:05.489597 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-67b3a136-579e-4dc4-a21c-5c2e86733773 req-0ea0be2a-22b9-4e12-a5bf-f69299b92b20 tempest-TestVolumeBootPattern-1443368191 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:13:06.897793 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.207s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:13:06.901497 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4678044e-7418-4ed6-afa9-88f7a689bd0c', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '4678044e-7418-4ed6-afa9-88f7a689bd0c', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:13:06.938449 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Initialize volume connection completed successfully. Oct 22 21:13:07.161643 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-67b3a136-579e-4dc4-a21c-5c2e86733773 req-0ea0be2a-22b9-4e12-a5bf-f69299b92b20 tempest-TestVolumeBootPattern-1443368191 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.672s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:13:07.162288 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-67b3a136-579e-4dc4-a21c-5c2e86733773 req-0ea0be2a-22b9-4e12-a5bf-f69299b92b20 tempest-TestVolumeBootPattern-1443368191 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b2b053a3-6082-4ecb-aa86-9bc2e5608d19', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'b2b053a3-6082-4ecb-aa86-9bc2e5608d19', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:13:07.198318 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-67b3a136-579e-4dc4-a21c-5c2e86733773 req-0ea0be2a-22b9-4e12-a5bf-f69299b92b20 tempest-TestVolumeBootPattern-1443368191 None] Connection info returned from driver {'name': 'volumes/volume-b2b053a3-6082-4ecb-aa86-9bc2e5608d19', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b2b053a3-6082-4ecb-aa86-9bc2e5608d19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '992335b0-0ac0-437d-914d-ec8ff00c1e5c'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:13:07.311375 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-67b3a136-579e-4dc4-a21c-5c2e86733773 req-0ea0be2a-22b9-4e12-a5bf-f69299b92b20 tempest-TestVolumeBootPattern-1443368191 None] attachment_update completed successfully. Oct 22 21:13:12.777254 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=60,cinder:UPDATE=12,cinder:INSERT=16,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:12.794976 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:13:12.819689 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Flow 'volume_create_manager' (7780302e-b0a2-4583-a1f0-517a2e3ec711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:12.826470 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4673865-452e-4789-84c8-c2e8ab00c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:12.849563 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4673865-452e-4789-84c8-c2e8ab00c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2016338852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7f2ec558-cfcf-434d-96e5-07cb49db6ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a5daff28e34fd3bf74fdb4d0ea667e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:13:13Z,use_quota=True,user_id='2c16f6ec7e87423fa1022da549f9f0bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f07ef5d9-195b-4e44-b5e8-18cbe40eb288),volume_type_id=f07ef5d9-195b-4e44-b5e8-18cbe40eb288)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:12.855368 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99075500-365e-4c20-b1f0-ebea279056de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:12.859487 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99075500-365e-4c20-b1f0-ebea279056de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:12.865352 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815536bd-a881-4dd0-8c44-c2bb96f68980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:12.873193 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815536bd-a881-4dd0-8c44-c2bb96f68980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2ec558-cfcf-434d-96e5-07cb49db6ff2', 'volume_name': 'volume-7f2ec558-cfcf-434d-96e5-07cb49db6ff2', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:12.879845 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9d9583-52ae-454e-9435-6911cdc469c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:12.883892 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9d9583-52ae-454e-9435-6911cdc469c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:12.890375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68256dc-a8d2-4a12-86e0-314b0e772ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:12.890576 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Volume 7f2ec558-cfcf-434d-96e5-07cb49db6ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2ec558-cfcf-434d-96e5-07cb49db6ff2', 'volume_size': 1} Oct 22 21:13:12.890887 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] creating volume 'volume-7f2ec558-cfcf-434d-96e5-07cb49db6ff2' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:13:12.891722 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:12.972997 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:13:12.973440 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:13:12.977840 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68256dc-a8d2-4a12-86e0-314b0e772ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2ec558-cfcf-434d-96e5-07cb49db6ff2', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:12.982959 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c584fe7d-dd9e-43ac-8709-623792e4122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:12.992732 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Volume volume-7f2ec558-cfcf-434d-96e5-07cb49db6ff2 (7f2ec558-cfcf-434d-96e5-07cb49db6ff2): created successfully Oct 22 21:13:12.996821 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c584fe7d-dd9e-43ac-8709-623792e4122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:13.002108 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Flow 'volume_create_manager' (7780302e-b0a2-4583-a1f0-517a2e3ec711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:13.012234 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-0a6eefc4-778a-4dba-a946-140ad958f5c9 tempest-VolumeTypesAccessTest-244128419 None] Created volume successfully. Oct 22 21:13:13.936122 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Terminate volume connection completed successfully. Oct 22 21:13:13.958068 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-68ad2721-c5ce-4081-a09e-805ecc5d427a tempest-TestVolumeBackupRestore-2071196610 None] Remove volume export completed successfully. Oct 22 21:13:14.207078 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] Acquiring lock "cinder-7f2ec558-cfcf-434d-96e5-07cb49db6ff2-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:13:14.219752 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] Lock "cinder-7f2ec558-cfcf-434d-96e5-07cb49db6ff2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:13:14.293546 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:14.362095 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:13:14.362528 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] Volume volume-7f2ec558-cfcf-434d-96e5-07cb49db6ff2 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:13:14.383987 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] deleting rbd volume volume-7f2ec558-cfcf-434d-96e5-07cb49db6ff2 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:13:14.783075 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1590558297 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1590558297, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:13:14.783968 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1590558297 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1590558297, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:13:14.802028 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] Created reservations ['0d963259-b64d-4d40-b115-49b3aac84270', 'a92b324a-cf04-4a18-b18d-a9770cae7763', '0833199f-b2a1-4512-a677-c7a148fe33c8', '9ed0613e-09fb-44f8-8de5-70fab31677ec'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:13:14.857826 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:14.900646 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:14.940102 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:13:14.945890 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] Deleted volume successfully. Oct 22 21:13:14.961982 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-fc9e000f-bfe6-4e1f-9661-a88caa1a347d tempest-VolumeTypesAccessTest-244128419 None] Lock "cinder-7f2ec558-cfcf-434d-96e5-07cb49db6ff2-delete_volume" released by "delete_volume" :: held 0.742s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:13:22.546512 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-c240def6-5699-4100-b8e4-b2b5e619f68c req-4303165e-66f5-4eaf-aac8-c4d2b9d4bd05 tempest-TestVolumeBackupRestore-2071196610 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:13:24.118366 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-c240def6-5699-4100-b8e4-b2b5e619f68c req-4303165e-66f5-4eaf-aac8-c4d2b9d4bd05 tempest-TestVolumeBackupRestore-2071196610 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.572s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:13:24.119260 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-c240def6-5699-4100-b8e4-b2b5e619f68c req-4303165e-66f5-4eaf-aac8-c4d2b9d4bd05 tempest-TestVolumeBackupRestore-2071196610 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4678044e-7418-4ed6-afa9-88f7a689bd0c', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '4678044e-7418-4ed6-afa9-88f7a689bd0c', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:13:24.188987 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-c240def6-5699-4100-b8e4-b2b5e619f68c req-4303165e-66f5-4eaf-aac8-c4d2b9d4bd05 tempest-TestVolumeBackupRestore-2071196610 None] Connection info returned from driver {'name': 'volumes/volume-4678044e-7418-4ed6-afa9-88f7a689bd0c', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4678044e-7418-4ed6-afa9-88f7a689bd0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2985580a-0fc6-4173-bbfa-3c770c8529e4'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:13:24.217118 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=66,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=11 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:24.339008 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-c240def6-5699-4100-b8e4-b2b5e619f68c req-4303165e-66f5-4eaf-aac8-c4d2b9d4bd05 tempest-TestVolumeBackupRestore-2071196610 None] attachment_update completed successfully. Oct 22 21:13:30.513916 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:13:30.517691 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:30.671286 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:30.842472 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:13:36.903793 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=30,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:42.253851 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:13:42.275634 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Flow 'volume_create_manager' (1ef04ddb-8e7e-466f-bff4-3487dffe0706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:42.282916 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a58a21-f7fb-4fdc-9b3f-a87b47411ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:42.316225 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a58a21-f7fb-4fdc-9b3f-a87b47411ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-34398962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c3d2ed04-7d94-4677-95f3-3146478267d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='755501ba3e344f1aaf7ef80924bb57d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:13:42Z,use_quota=True,user_id='ba0d0bdfb04240209e4efa92f47cbb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:42.316456 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885caa98-11f5-429a-8efe-b556624e40e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:42.317561 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885caa98-11f5-429a-8efe-b556624e40e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:42.323078 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9337de-e70e-4831-aa60-3e33b1ae5d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:42.327302 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9337de-e70e-4831-aa60-3e33b1ae5d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d2ed04-7d94-4677-95f3-3146478267d8', 'volume_name': 'volume-c3d2ed04-7d94-4677-95f3-3146478267d8', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:42.332075 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40905be-f5f5-4a2b-87b3-e60cab59cd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:42.335767 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40905be-f5f5-4a2b-87b3-e60cab59cd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:42.340438 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b948bc-c807-47d2-a7e7-ca3e87dcd909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:42.341691 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Volume c3d2ed04-7d94-4677-95f3-3146478267d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d2ed04-7d94-4677-95f3-3146478267d8', 'volume_size': 1} Oct 22 21:13:42.342251 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] creating volume 'volume-c3d2ed04-7d94-4677-95f3-3146478267d8' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:13:42.343217 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:42.551262 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-70a94dcb-5407-4f50-94f8-ec1d57061b46 req-ec39ce90-3620-4b9e-becd-ad070c39e97f tempest-AttachVolumeShelveTestJSON-1454811106 None] No connector for attachment 1838997f-0a93-4442-9ad8-5991dfc4f6da; skipping storage backend terminate_connection call. {{(pid=131630) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4953}} Oct 22 21:13:42.551827 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-70a94dcb-5407-4f50-94f8-ec1d57061b46 req-ec39ce90-3620-4b9e-becd-ad070c39e97f tempest-AttachVolumeShelveTestJSON-1454811106 None] Deleting attachment 1838997f-0a93-4442-9ad8-5991dfc4f6da. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:13:43.008052 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:13:43.008755 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:13:43.021031 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b948bc-c807-47d2-a7e7-ca3e87dcd909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d2ed04-7d94-4677-95f3-3146478267d8', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:43.053515 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447e4209-3214-435f-a8ba-e99837d8f274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:43.092329 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Volume volume-c3d2ed04-7d94-4677-95f3-3146478267d8 (c3d2ed04-7d94-4677-95f3-3146478267d8): created successfully Oct 22 21:13:43.115016 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447e4209-3214-435f-a8ba-e99837d8f274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:43.121032 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Flow 'volume_create_manager' (1ef04ddb-8e7e-466f-bff4-3487dffe0706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:43.146917 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e96edc4b-eb8d-4bda-ad15-d20ea2dc0945 tempest-AttachVolumeTestJSON-485250435 None] Created volume successfully. Oct 22 21:13:45.214381 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-3d556c3c-01b5-454e-b0ed-5affb2876301 req-c57a708e-3140-4f84-bb18-b4c388fa4fcf tempest-AttachVolumeTestJSON-485250435 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:13:46.383709 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-3d556c3c-01b5-454e-b0ed-5affb2876301 req-c57a708e-3140-4f84-bb18-b4c388fa4fcf tempest-AttachVolumeTestJSON-485250435 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.169s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:13:46.384856 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-3d556c3c-01b5-454e-b0ed-5affb2876301 req-c57a708e-3140-4f84-bb18-b4c388fa4fcf tempest-AttachVolumeTestJSON-485250435 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c3d2ed04-7d94-4677-95f3-3146478267d8', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'c3d2ed04-7d94-4677-95f3-3146478267d8', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:13:46.424254 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-3d556c3c-01b5-454e-b0ed-5affb2876301 req-c57a708e-3140-4f84-bb18-b4c388fa4fcf tempest-AttachVolumeTestJSON-485250435 None] Connection info returned from driver {'name': 'volumes/volume-c3d2ed04-7d94-4677-95f3-3146478267d8', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c3d2ed04-7d94-4677-95f3-3146478267d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2d69a802-e40f-45db-938c-f1b1f655e333'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:13:46.534603 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-3d556c3c-01b5-454e-b0ed-5affb2876301 req-c57a708e-3140-4f84-bb18-b4c388fa4fcf tempest-AttachVolumeTestJSON-485250435 None] attachment_update completed successfully. Oct 22 21:13:49.035492 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:13:49.067524 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Flow 'volume_create_manager' (61a57d47-1be8-4d20-a738-f05d5cb73bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:49.077745 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b206d6-3cda-42b4-ad55-a21fa16a0750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:49.106664 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b206d6-3cda-42b4-ad55-a21fa16a0750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2031240333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=892ac359-4f4c-4fa6-acef-543e24a4f004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='755501ba3e344f1aaf7ef80924bb57d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:13:49Z,use_quota=True,user_id='ba0d0bdfb04240209e4efa92f47cbb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:49.112545 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a284d5-51af-401f-9ba3-6dd3b5322bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:49.116885 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a284d5-51af-401f-9ba3-6dd3b5322bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:49.122722 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1e5f41-8587-4783-9a33-8c3a9141d9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:49.126948 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1e5f41-8587-4783-9a33-8c3a9141d9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '892ac359-4f4c-4fa6-acef-543e24a4f004', 'volume_name': 'volume-892ac359-4f4c-4fa6-acef-543e24a4f004', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:49.132646 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c3cf7f-23f7-4b9c-8e44-56bc1df0b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:49.137456 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c3cf7f-23f7-4b9c-8e44-56bc1df0b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:49.142608 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062e9ef9-ba0f-4c91-a49f-a87ac55b4f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:49.143970 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Volume 892ac359-4f4c-4fa6-acef-543e24a4f004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-892ac359-4f4c-4fa6-acef-543e24a4f004', 'volume_size': 1} Oct 22 21:13:49.144395 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] creating volume 'volume-892ac359-4f4c-4fa6-acef-543e24a4f004' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:13:49.145177 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:49.236791 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:13:49.237078 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:13:49.241172 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062e9ef9-ba0f-4c91-a49f-a87ac55b4f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892ac359-4f4c-4fa6-acef-543e24a4f004', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:49.246012 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75e5bf7-ab51-441a-82e5-e4f117229d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:49.258461 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Volume volume-892ac359-4f4c-4fa6-acef-543e24a4f004 (892ac359-4f4c-4fa6-acef-543e24a4f004): created successfully Oct 22 21:13:49.262716 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75e5bf7-ab51-441a-82e5-e4f117229d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:49.268827 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Flow 'volume_create_manager' (61a57d47-1be8-4d20-a738-f05d5cb73bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:49.280057 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-86993116-71a3-4d97-97ac-fe57c0ba1b0e tempest-AttachVolumeTestJSON-485250435 None] Created volume successfully. Oct 22 21:13:51.583962 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-a0670ed3-2309-42de-81bd-c2f0d5035edd req-2f6336ba-7fbc-40d6-85c2-95d019e6fd61 tempest-AttachVolumeTestJSON-485250435 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:13:51.805920 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:13:51.859622 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (6d13c32b-d331-4a36-a280-41b058ae26bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:51.910844 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40af8df4-3e2a-4cc2-8cf6-e74e3900a299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:52.002995 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40af8df4-3e2a-4cc2-8cf6-e74e3900a299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1490871247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2e94890b-9501-4e90-b25b-4a47ebff4bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c7a88417a446cd87a91bf19ef81232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:13:52Z,use_quota=True,user_id='037ea1eef49c4f7fba0dec413ce15e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:52.022146 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddd4ee9-bc39-43b4-8ebc-c8bbc7c6997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:52.026154 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddd4ee9-bc39-43b4-8ebc-c8bbc7c6997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:52.048729 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498ed4bd-809c-4d33-b66a-eb7e7d526e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:52.052897 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498ed4bd-809c-4d33-b66a-eb7e7d526e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e94890b-9501-4e90-b25b-4a47ebff4bfb', 'volume_name': 'volume-2e94890b-9501-4e90-b25b-4a47ebff4bfb', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:52.061287 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea862efa-0463-436f-9a9d-9b5064491e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:52.075237 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea862efa-0463-436f-9a9d-9b5064491e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:52.080271 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f172e0-d0c8-42e1-9ca3-7652f8287e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:52.081651 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Volume 2e94890b-9501-4e90-b25b-4a47ebff4bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e94890b-9501-4e90-b25b-4a47ebff4bfb', 'volume_size': 1} Oct 22 21:13:52.082322 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] creating volume 'volume-2e94890b-9501-4e90-b25b-4a47ebff4bfb' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:13:52.083308 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:13:52.209076 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:13:52.210407 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:13:52.216386 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f172e0-d0c8-42e1-9ca3-7652f8287e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e94890b-9501-4e90-b25b-4a47ebff4bfb', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:52.224797 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cc624e-d14d-4fd0-9c2b-7284dcc273dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:52.255671 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Volume volume-2e94890b-9501-4e90-b25b-4a47ebff4bfb (2e94890b-9501-4e90-b25b-4a47ebff4bfb): created successfully Oct 22 21:13:52.266921 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cc624e-d14d-4fd0-9c2b-7284dcc273dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:52.281673 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (6d13c32b-d331-4a36-a280-41b058ae26bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:52.302530 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-013e9635-550b-4cbf-8aa9-b3d7ed94519e tempest-VolumesActionsTest-1108413952 None] Created volume successfully. Oct 22 21:13:52.801035 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-50a709bb-ab5f-42e1-a112-28689060db3b tempest-VolumesActionsTest-1108413952 None] Acquiring lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb" by "attach_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:13:52.838962 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-50a709bb-ab5f-42e1-a112-28689060db3b tempest-VolumesActionsTest-1108413952 None] Lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb" acquired by "attach_volume" :: waited 0.038s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:13:53.001447 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-50a709bb-ab5f-42e1-a112-28689060db3b tempest-VolumesActionsTest-1108413952 None] Attaching volume 2e94890b-9501-4e90-b25b-4a47ebff4bfb to instance 75885b47-51e4-4752-8150-00dff6c524f6 at mountpoint /dev/sdb on host None. Oct 22 21:13:53.078560 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-50a709bb-ab5f-42e1-a112-28689060db3b tempest-VolumesActionsTest-1108413952 None] Attach volume completed successfully. Oct 22 21:13:53.101321 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-50a709bb-ab5f-42e1-a112-28689060db3b tempest-VolumesActionsTest-1108413952 None] Lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb" released by "attach_volume" :: held 0.260s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:13:53.301961 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-a0670ed3-2309-42de-81bd-c2f0d5035edd req-2f6336ba-7fbc-40d6-85c2-95d019e6fd61 tempest-AttachVolumeTestJSON-485250435 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.718s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:13:53.302999 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-a0670ed3-2309-42de-81bd-c2f0d5035edd req-2f6336ba-7fbc-40d6-85c2-95d019e6fd61 tempest-AttachVolumeTestJSON-485250435 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-892ac359-4f4c-4fa6-acef-543e24a4f004', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '892ac359-4f4c-4fa6-acef-543e24a4f004', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:13:53.343421 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-a0670ed3-2309-42de-81bd-c2f0d5035edd req-2f6336ba-7fbc-40d6-85c2-95d019e6fd61 tempest-AttachVolumeTestJSON-485250435 None] Connection info returned from driver {'name': 'volumes/volume-892ac359-4f4c-4fa6-acef-543e24a4f004', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '892ac359-4f4c-4fa6-acef-543e24a4f004', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'da148494-0f52-4f2b-b04e-0c2ff739f574'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:13:53.478707 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-a0670ed3-2309-42de-81bd-c2f0d5035edd req-2f6336ba-7fbc-40d6-85c2-95d019e6fd61 tempest-AttachVolumeTestJSON-485250435 None] attachment_update completed successfully. Oct 22 21:13:54.156820 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7fe12cd5-99ff-40ce-b264-c9315cec154b tempest-VolumesActionsTest-1802173559 None] Terminate volume connection completed successfully. Oct 22 21:13:54.189822 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7fe12cd5-99ff-40ce-b264-c9315cec154b tempest-VolumesActionsTest-1802173559 None] Acquiring lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb-detach_volume" by "detach_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:13:54.220607 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7fe12cd5-99ff-40ce-b264-c9315cec154b tempest-VolumesActionsTest-1802173559 None] Lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:13:54.253203 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7fe12cd5-99ff-40ce-b264-c9315cec154b tempest-VolumesActionsTest-1802173559 None] Detaching volume 2e94890b-9501-4e90-b25b-4a47ebff4bfb from instance 75885b47-51e4-4752-8150-00dff6c524f6. Oct 22 21:13:54.326075 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=52,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:13:54.342538 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7fe12cd5-99ff-40ce-b264-c9315cec154b tempest-VolumesActionsTest-1802173559 None] Detach volume completed successfully. Oct 22 21:13:54.362554 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7fe12cd5-99ff-40ce-b264-c9315cec154b tempest-VolumesActionsTest-1802173559 None] Lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:13:54.775065 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e1a8f65f-27f4-4d99-8f87-a93e33c4faa3 tempest-VolumesActionsTest-1108413952 None] Acquiring lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb-detach_volume" by "detach_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:13:54.787650 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e1a8f65f-27f4-4d99-8f87-a93e33c4faa3 tempest-VolumesActionsTest-1108413952 None] Lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:13:54.788472 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e1a8f65f-27f4-4d99-8f87-a93e33c4faa3 tempest-VolumesActionsTest-1108413952 None] Volume detach called, but volume not attached. Oct 22 21:13:54.820961 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e1a8f65f-27f4-4d99-8f87-a93e33c4faa3 tempest-VolumesActionsTest-1108413952 None] Lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:13:59.879884 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:13:59.901489 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (ae1f4135-ae1b-4118-82e0-4bf61652827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:13:59.908356 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13718914-0c5d-4838-9ef2-df40429a8192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:59.926376 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13718914-0c5d-4838-9ef2-df40429a8192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623129661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fde7d985-51db-4422-afef-5387b67c7160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c7a88417a446cd87a91bf19ef81232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:14:00Z,use_quota=True,user_id='037ea1eef49c4f7fba0dec413ce15e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:59.931475 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25b7fb4-eacd-46fe-8922-59d612bcc403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:59.935605 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25b7fb4-eacd-46fe-8922-59d612bcc403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:59.940400 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d39857d-214b-4fec-afb6-f70d13b5d6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:59.944220 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d39857d-214b-4fec-afb6-f70d13b5d6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fde7d985-51db-4422-afef-5387b67c7160', 'volume_name': 'volume-fde7d985-51db-4422-afef-5387b67c7160', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:59.948797 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90dc6c35-a893-48da-a6be-cb9e32a39833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:59.952622 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90dc6c35-a893-48da-a6be-cb9e32a39833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:13:59.957996 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519cda90-1efb-4434-9c02-4577b9ea952b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:13:59.959140 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Volume fde7d985-51db-4422-afef-5387b67c7160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fde7d985-51db-4422-afef-5387b67c7160', 'volume_size': 1} Oct 22 21:13:59.959635 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] creating volume 'volume-fde7d985-51db-4422-afef-5387b67c7160' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:13:59.960370 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:00.015060 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:14:00.015471 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:14:00.019160 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519cda90-1efb-4434-9c02-4577b9ea952b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fde7d985-51db-4422-afef-5387b67c7160', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:00.023547 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d445de0c-5b51-4e32-ac98-a7266f43fbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:00.035886 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Volume volume-fde7d985-51db-4422-afef-5387b67c7160 (fde7d985-51db-4422-afef-5387b67c7160): created successfully Oct 22 21:14:00.039619 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d445de0c-5b51-4e32-ac98-a7266f43fbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:00.045009 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (ae1f4135-ae1b-4118-82e0-4bf61652827d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:00.054265 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9a33055f-7296-4405-b46c-ad1f637af377 tempest-VolumesActionsTest-1108413952 None] Created volume successfully. Oct 22 21:14:01.073218 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] Acquiring lock "cinder-fde7d985-51db-4422-afef-5387b67c7160-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:01.084525 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] Lock "cinder-fde7d985-51db-4422-afef-5387b67c7160-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:01.112684 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:01.153176 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:14:01.153673 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] Volume volume-fde7d985-51db-4422-afef-5387b67c7160 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:01.161428 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] deleting rbd volume volume-fde7d985-51db-4422-afef-5387b67c7160 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:01.386415 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] Created reservations ['d4e2f9b1-4620-4bf5-943d-634820453cc4', '3bd45532-0c57-453c-b551-e1f11d2b908c', '7d3e4ee1-1aa9-4f2b-819e-8c8e72365f05', 'e9563a0f-b4ef-4c41-8325-a08b6e56f577'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:01.434064 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:01.459923 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:01.488610 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:01.493043 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] Deleted volume successfully. Oct 22 21:14:01.513781 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-78a7a81b-5f0e-4d3b-b5b7-e2a31a425329 tempest-VolumesActionsTest-1802173559 None] Lock "cinder-fde7d985-51db-4422-afef-5387b67c7160-delete_volume" released by "delete_volume" :: held 0.422s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:02.507499 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=71,cinder:DELETE=4,cinder:UPDATE=21,cinder:INSERT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:02.516023 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:14:02.535404 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (f85e9c32-9c4d-4401-811d-47530d14c00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:02.541677 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5382ed9e-6ada-47a4-a0a1-911d4ffcd86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:02.561420 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5382ed9e-6ada-47a4-a0a1-911d4ffcd86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1504702007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f0c9732d-42fd-48eb-b746-eddd827a3138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c7a88417a446cd87a91bf19ef81232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:14:02Z,use_quota=True,user_id='037ea1eef49c4f7fba0dec413ce15e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:02.566777 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371113d8-0a1a-4819-a61b-3149b80e6449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:02.570613 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371113d8-0a1a-4819-a61b-3149b80e6449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:02.575827 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ac3578-2010-4def-948c-412e8fbf846f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:02.580392 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ac3578-2010-4def-948c-412e8fbf846f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0c9732d-42fd-48eb-b746-eddd827a3138', 'volume_name': 'volume-f0c9732d-42fd-48eb-b746-eddd827a3138', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:02.584441 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae13437e-4c11-4238-8292-65e633124032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:02.588056 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae13437e-4c11-4238-8292-65e633124032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:02.592392 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f905bb2a-d615-4c1c-abd9-9e2bdb536f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:02.593520 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Volume f0c9732d-42fd-48eb-b746-eddd827a3138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0c9732d-42fd-48eb-b746-eddd827a3138', 'volume_size': 1} Oct 22 21:14:02.593913 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] creating volume 'volume-f0c9732d-42fd-48eb-b746-eddd827a3138' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:14:02.594676 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:02.681343 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:14:02.681828 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:14:02.685491 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f905bb2a-d615-4c1c-abd9-9e2bdb536f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c9732d-42fd-48eb-b746-eddd827a3138', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:02.690083 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66085d81-5e1a-4af2-a6b7-b08558488290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:02.700916 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Volume volume-f0c9732d-42fd-48eb-b746-eddd827a3138 (f0c9732d-42fd-48eb-b746-eddd827a3138): created successfully Oct 22 21:14:02.705352 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66085d81-5e1a-4af2-a6b7-b08558488290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:02.710711 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (f85e9c32-9c4d-4401-811d-47530d14c00a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:02.721364 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-02b6afaf-3a55-4e1a-aa23-1a6042498cf7 tempest-VolumesActionsTest-1108413952 None] Created volume successfully. Oct 22 21:14:03.717557 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] Acquiring lock "cinder-f0c9732d-42fd-48eb-b746-eddd827a3138-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:03.736490 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] Lock "cinder-f0c9732d-42fd-48eb-b746-eddd827a3138-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:03.768168 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:03.812843 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:14:03.813193 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] Volume volume-f0c9732d-42fd-48eb-b746-eddd827a3138 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:03.820388 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] deleting rbd volume volume-f0c9732d-42fd-48eb-b746-eddd827a3138 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:04.055057 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] Created reservations ['2ab7d7a6-1c8c-4448-8eee-f8e2c2b1525e', '0558167a-777e-49b3-a57d-79649200250a', '7a74e411-961b-404b-8660-163750800e1e', 'cb4ecc90-e552-4c2a-8063-cb2145c5444d'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:04.104167 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:04.129399 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:04.159851 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:04.164008 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] Deleted volume successfully. Oct 22 21:14:04.186885 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c7f5fb00-a4ad-4dbc-8952-5492c4f99d71 tempest-VolumesActionsTest-1802173559 None] Lock "cinder-f0c9732d-42fd-48eb-b746-eddd827a3138-delete_volume" released by "delete_volume" :: held 0.442s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:05.152639 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:14:05.171937 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (c91f9a29-71e5-4db7-b31e-3208062062b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:05.178434 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4985f2b1-0796-4365-b125-5cd25e562c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:05.195118 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4985f2b1-0796-4365-b125-5cd25e562c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-615040437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=19f615e2-7559-4839-8627-815983db1414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c7a88417a446cd87a91bf19ef81232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:14:05Z,use_quota=True,user_id='037ea1eef49c4f7fba0dec413ce15e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:05.200249 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580b9bd4-1547-4f89-896e-0f0f35f96025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:05.204531 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580b9bd4-1547-4f89-896e-0f0f35f96025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:05.209402 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32922463-4657-457e-9145-48ee4585befe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:05.213288 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32922463-4657-457e-9145-48ee4585befe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f615e2-7559-4839-8627-815983db1414', 'volume_name': 'volume-19f615e2-7559-4839-8627-815983db1414', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:05.217950 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657ff545-3748-460a-9a31-4392ae06fc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:05.221986 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657ff545-3748-460a-9a31-4392ae06fc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:05.226900 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1347017e-88eb-4890-bfba-5ada24de69a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:05.227975 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Volume 19f615e2-7559-4839-8627-815983db1414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f615e2-7559-4839-8627-815983db1414', 'volume_size': 1} Oct 22 21:14:05.228394 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] creating volume 'volume-19f615e2-7559-4839-8627-815983db1414' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:14:05.229234 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:05.291225 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:14:05.291684 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:14:05.295298 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1347017e-88eb-4890-bfba-5ada24de69a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f615e2-7559-4839-8627-815983db1414', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:05.299792 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52817b7-a64e-42fd-a1ef-cae701442035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:05.310897 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Volume volume-19f615e2-7559-4839-8627-815983db1414 (19f615e2-7559-4839-8627-815983db1414): created successfully Oct 22 21:14:05.314557 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52817b7-a64e-42fd-a1ef-cae701442035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:05.319776 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (c91f9a29-71e5-4db7-b31e-3208062062b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:05.330457 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-438e6264-0ca5-4c14-9531-9f2280528480 tempest-VolumesActionsTest-1108413952 None] Created volume successfully. Oct 22 21:14:06.360086 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] Acquiring lock "cinder-19f615e2-7559-4839-8627-815983db1414-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:06.374153 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] Lock "cinder-19f615e2-7559-4839-8627-815983db1414-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:06.405165 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:06.451728 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:14:06.452179 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] Volume volume-19f615e2-7559-4839-8627-815983db1414 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:06.458595 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] deleting rbd volume volume-19f615e2-7559-4839-8627-815983db1414 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:06.730482 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] Created reservations ['4d42d0f5-07e3-42ad-8cfe-bf4bcd03cae9', '1425c520-a16f-42da-96ac-f853481874b7', 'fa33f638-4813-4f2e-b979-db7200cf0b71', '8b328314-4d55-406e-9688-9364ccb67f4f'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:06.797274 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:06.829433 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:06.858538 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:06.866648 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] Deleted volume successfully. Oct 22 21:14:06.883010 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-715415c2-267c-458c-956a-f1d8515c7eb8 tempest-VolumesActionsTest-1802173559 None] Lock "cinder-19f615e2-7559-4839-8627-815983db1414-delete_volume" released by "delete_volume" :: held 0.506s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:07.784065 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:14:07.804089 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (cac7cb82-78e3-453d-8faa-47a0edeab382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:07.810779 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ac61f4-aef9-4ede-867e-7c1b52e66f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:07.835494 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ac61f4-aef9-4ede-867e-7c1b52e66f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-961084423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c7a88417a446cd87a91bf19ef81232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:14:08Z,use_quota=True,user_id='037ea1eef49c4f7fba0dec413ce15e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:07.840316 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91dc7f91-14f8-40a9-8a65-6c9cbd6d4b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:07.844198 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91dc7f91-14f8-40a9-8a65-6c9cbd6d4b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:07.849299 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d2b6c1-d24e-4f68-9aee-da49f6829434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:07.853775 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d2b6c1-d24e-4f68-9aee-da49f6829434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee', 'volume_name': 'volume-cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:07.859327 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4f0208-8f6c-4694-9cb3-57bf67c9cd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:07.862575 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4f0208-8f6c-4694-9cb3-57bf67c9cd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:07.867143 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbae2c4c-5b5d-44dd-9324-2ca9afee9cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:07.868258 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Volume cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee', 'volume_size': 1} Oct 22 21:14:07.868815 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] creating volume 'volume-cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:14:07.869404 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:07.954139 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:14:07.954528 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:14:07.959035 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbae2c4c-5b5d-44dd-9324-2ca9afee9cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:07.963678 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929a8740-232c-44f0-bee6-7f80104d31ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:07.975678 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Volume volume-cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee (cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee): created successfully Oct 22 21:14:07.980180 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929a8740-232c-44f0-bee6-7f80104d31ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:07.985837 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (cac7cb82-78e3-453d-8faa-47a0edeab382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:07.995883 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f7def7c4-629a-448b-9011-bc0657599b74 tempest-VolumesActionsTest-1108413952 None] Created volume successfully. Oct 22 21:14:08.666356 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-9adc7b18-1452-42c3-9dca-f16020969d17 req-f3c1bda8-884a-4f74-9639-274dc2aabde5 tempest-AttachVolumeTestJSON-485250435 None] Terminate volume connection completed successfully. Oct 22 21:14:08.666773 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-9adc7b18-1452-42c3-9dca-f16020969d17 req-f3c1bda8-884a-4f74-9639-274dc2aabde5 tempest-AttachVolumeTestJSON-485250435 None] Deleting attachment 2d69a802-e40f-45db-938c-f1b1f655e333. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:14:08.995993 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] Acquiring lock "cinder-cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:09.009527 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] Lock "cinder-cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:09.045631 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:09.090715 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:14:09.091207 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] Volume volume-cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:09.096678 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] deleting rbd volume volume-cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:09.414547 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] Created reservations ['dd0eb5a3-9eb6-4938-9e76-238837a92441', '73f1231a-f346-4362-9bcc-c868760090e4', '3b3c31a7-21e5-4610-8bd7-c3fa5b60ab4d', '5a192fef-d4f1-4b8d-a474-c4775cf2a49d'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:09.419502 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=61,cinder:UPDATE=34,cinder:INSERT=4,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:09.473671 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:09.520574 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:09.563517 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:09.573338 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] Deleted volume successfully. Oct 22 21:14:09.586059 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-949d09b1-55b9-4fa0-aa8d-18d905d19a69 tempest-VolumesActionsTest-1802173559 None] Lock "cinder-cfb45b2c-19a0-48a7-b7b0-9dd1e0e0b6ee-delete_volume" released by "delete_volume" :: held 0.577s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:10.241277 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-fe55a23f-4b8b-440c-9d14-341b901dcacd req-17c55668-0601-498e-9fb9-083fee515c67 tempest-AttachVolumeTestJSON-485250435 None] Terminate volume connection completed successfully. Oct 22 21:14:10.242204 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-fe55a23f-4b8b-440c-9d14-341b901dcacd req-17c55668-0601-498e-9fb9-083fee515c67 tempest-AttachVolumeTestJSON-485250435 None] Deleting attachment da148494-0f52-4f2b-b04e-0c2ff739f574. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:14:10.459898 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:14:10.480148 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (6a83538c-fcc7-405e-aff0-029ce6dfe3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:10.486522 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6053e15d-07b3-4ab7-bb6a-a0c13a255bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:10.504691 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6053e15d-07b3-4ab7-bb6a-a0c13a255bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-119082168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=957248ce-a791-4b86-9811-def47fecb517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c7a88417a446cd87a91bf19ef81232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:14:10Z,use_quota=True,user_id='037ea1eef49c4f7fba0dec413ce15e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:10.510144 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5a9f74-d707-479a-9799-1132408e7211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:10.514088 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5a9f74-d707-479a-9799-1132408e7211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:10.519133 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15e85bc-a715-444e-98d9-f0ca5769a1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:10.523095 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15e85bc-a715-444e-98d9-f0ca5769a1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '957248ce-a791-4b86-9811-def47fecb517', 'volume_name': 'volume-957248ce-a791-4b86-9811-def47fecb517', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:10.528065 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b49ebd-1170-4a82-b3ee-a72d82cfd897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:10.532027 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b49ebd-1170-4a82-b3ee-a72d82cfd897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:10.536308 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230cfad4-a507-4e84-ba87-9f666a968d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:10.537556 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Volume 957248ce-a791-4b86-9811-def47fecb517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-957248ce-a791-4b86-9811-def47fecb517', 'volume_size': 1} Oct 22 21:14:10.537948 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] creating volume 'volume-957248ce-a791-4b86-9811-def47fecb517' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:14:10.538726 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:10.611540 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:14:10.611954 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:14:10.616051 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230cfad4-a507-4e84-ba87-9f666a968d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957248ce-a791-4b86-9811-def47fecb517', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:10.620724 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60df16b0-232d-434c-a2fa-42715da02cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:10.630784 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Volume volume-957248ce-a791-4b86-9811-def47fecb517 (957248ce-a791-4b86-9811-def47fecb517): created successfully Oct 22 21:14:10.635280 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60df16b0-232d-434c-a2fa-42715da02cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:10.640973 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Flow 'volume_create_manager' (6a83538c-fcc7-405e-aff0-029ce6dfe3a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:10.655502 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7e2aa625-a59d-4979-aacd-c803ffafe58d tempest-VolumesActionsTest-1108413952 None] Created volume successfully. Oct 22 21:14:12.059680 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] Acquiring lock "cinder-957248ce-a791-4b86-9811-def47fecb517-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:12.071082 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] Lock "cinder-957248ce-a791-4b86-9811-def47fecb517-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:12.080361 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=55,cinder:DELETE=5,cinder:UPDATE=31,cinder:INSERT=9 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:12.112802 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:12.164540 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:14:12.165064 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] Volume volume-957248ce-a791-4b86-9811-def47fecb517 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:12.176482 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] deleting rbd volume volume-957248ce-a791-4b86-9811-def47fecb517 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:12.442054 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] Created reservations ['98578b23-b3c7-4b2c-a2bd-4d39305c558f', '2aa3b266-d3d9-4997-9655-27d2a34e060c', '72ecd515-5044-44d6-ada5-caef6a91c34c', '961547fe-4446-4d30-bd93-f8ba44f5fa0b'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:12.493763 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:12.527575 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:12.556979 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:12.561231 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] Deleted volume successfully. Oct 22 21:14:12.576658 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c994fe51-4dff-4612-a72d-4fa1d13f98b3 tempest-VolumesActionsTest-1108413952 None] Lock "cinder-957248ce-a791-4b86-9811-def47fecb517-delete_volume" released by "delete_volume" :: held 0.503s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:13.318487 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] Acquiring lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:13.334275 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] Lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:13.428743 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:13.515114 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:14:13.515853 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] Volume volume-2e94890b-9501-4e90-b25b-4a47ebff4bfb is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:13.527745 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] deleting rbd volume volume-2e94890b-9501-4e90-b25b-4a47ebff4bfb {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:13.882638 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] Created reservations ['af2be58f-437f-460a-a0f6-2ec9be42e083', '2962c6ca-f437-43f8-904a-158ddc2f4873', '7eeb1e26-ab83-4ea1-b401-ab4a3689f243', '84dfef5d-ada1-4354-940b-d7e2f6124090'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:13.938093 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:13.981767 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:14.027327 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:14.033523 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] Deleted volume successfully. Oct 22 21:14:14.047552 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f3b7fad9-d81d-4042-a6a8-4eb5ae2e6ad1 tempest-VolumesActionsTest-1108413952 None] Lock "cinder-2e94890b-9501-4e90-b25b-4a47ebff4bfb-delete_volume" released by "delete_volume" :: held 0.713s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:18.055845 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] Acquiring lock "cinder-892ac359-4f4c-4fa6-acef-543e24a4f004-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:18.067984 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] Lock "cinder-892ac359-4f4c-4fa6-acef-543e24a4f004-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:18.129904 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:18.182368 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:14:18.182788 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] Volume volume-892ac359-4f4c-4fa6-acef-543e24a4f004 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:18.195989 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] deleting rbd volume volume-892ac359-4f4c-4fa6-acef-543e24a4f004 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:18.313719 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:14:18.334799 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Flow 'volume_create_manager' (90ddb5de-5f41-4aac-be43-93703e4b95c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:18.341652 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17208bf-ba3c-4f13-a96a-8d3e469871c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:18.360066 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17208bf-ba3c-4f13-a96a-8d3e469871c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1422533024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=52f315b5-455c-4987-8ca7-2e5d415d5ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a25f382da0674f74ada627cf75ad37d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:14:18Z,use_quota=True,user_id='d25f7d1fb76e4eb5a8af45ff5d61efce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:18.365993 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6348ff97-3ff8-4e52-81fd-d19eb29aa9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:18.371158 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6348ff97-3ff8-4e52-81fd-d19eb29aa9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:18.376650 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43f655e-7373-48db-95f4-247709a52944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:18.381783 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43f655e-7373-48db-95f4-247709a52944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f315b5-455c-4987-8ca7-2e5d415d5ad2', 'volume_name': 'volume-52f315b5-455c-4987-8ca7-2e5d415d5ad2', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:18.387100 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686721b2-c966-429f-bd9f-8f1bab272ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:18.391316 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686721b2-c966-429f-bd9f-8f1bab272ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:18.396759 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13c5d2d-88c8-4e9b-8c5f-6a937ec58c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:18.398270 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Volume 52f315b5-455c-4987-8ca7-2e5d415d5ad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f315b5-455c-4987-8ca7-2e5d415d5ad2', 'volume_size': 1} Oct 22 21:14:18.398920 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] creating volume 'volume-52f315b5-455c-4987-8ca7-2e5d415d5ad2' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:14:18.399846 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:18.471094 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:14:18.471881 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:14:18.476566 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13c5d2d-88c8-4e9b-8c5f-6a937ec58c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f315b5-455c-4987-8ca7-2e5d415d5ad2', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:18.481054 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53205c13-f0e3-453d-b93e-bb4ca9c2aa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:18.491984 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Volume volume-52f315b5-455c-4987-8ca7-2e5d415d5ad2 (52f315b5-455c-4987-8ca7-2e5d415d5ad2): created successfully Oct 22 21:14:18.495623 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53205c13-f0e3-453d-b93e-bb4ca9c2aa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:18.500903 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Flow 'volume_create_manager' (90ddb5de-5f41-4aac-be43-93703e4b95c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:18.512629 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9c71a367-1454-435f-8381-f54a2fcc867d tempest-VolumesBackupsTest-1343612709 None] Created volume successfully. Oct 22 21:14:18.536918 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] Created reservations ['cfd1f8ef-7269-41c0-80a4-d39718e7f614', '67fd82c7-e0b0-4c44-9dbf-acea849d47aa', '6a2688ac-a6db-4c80-bf11-545e84476076', 'd6795a21-3f40-4f2c-9f47-c4817770ed45'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:18.586094 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:18.621122 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:18.699306 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:18.713747 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] Deleted volume successfully. Oct 22 21:14:18.746904 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b040bab0-9f6a-4b2d-8102-2540513ff451 tempest-AttachVolumeTestJSON-485250435 None] Lock "cinder-892ac359-4f4c-4fa6-acef-543e24a4f004-delete_volume" released by "delete_volume" :: held 0.666s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:19.223123 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] Acquiring lock "cinder-c3d2ed04-7d94-4677-95f3-3146478267d8-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:19.239085 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] Lock "cinder-c3d2ed04-7d94-4677-95f3-3146478267d8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:19.303771 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:19.360020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:14:19.360532 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] Volume volume-c3d2ed04-7d94-4677-95f3-3146478267d8 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:19.370189 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] deleting rbd volume volume-c3d2ed04-7d94-4677-95f3-3146478267d8 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:19.619225 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=56,cinder:UPDATE=33,cinder:DELETE=5,cinder:INSERT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:19.655874 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] Created reservations ['66310b06-4fe6-4259-8736-b52b0dbf569a', '25df1aad-07bf-4dcb-a4d2-368c419296f5', '6906a3c1-4d20-4f98-806b-54fd2eece4b0', 'b5ac9715-2309-4b34-9849-d8dbda2a53f0'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:19.708836 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:19.745122 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:19.785493 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:19.790741 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] Deleted volume successfully. Oct 22 21:14:19.806975 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c054c9e1-36c1-4c24-a9bb-845a79e3278a tempest-AttachVolumeTestJSON-485250435 None] Lock "cinder-c3d2ed04-7d94-4677-95f3-3146478267d8-delete_volume" released by "delete_volume" :: held 0.568s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:20.513400 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] Acquiring lock "cinder-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:20.532906 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] Lock "cinder-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:20.583672 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:20.647968 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:14:20.648711 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] Volume volume-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:20.662174 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] deleting rbd volume volume-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:20.963315 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=58,cinder:INSERT=7,cinder:UPDATE=35 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:21.003792 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] Created reservations ['971cff14-3297-48fc-a019-bcdc0467f65d', '270dd499-66b9-4138-bac1-590115d92628', 'd1ac6fa2-6cf5-4f33-a7f8-eeee72ac1c8b', '61d69084-1216-4581-beb8-ea56de07c7df'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:21.062504 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:21.103404 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:21.166547 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:21.171473 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] Deleted volume successfully. Oct 22 21:14:21.187646 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8bee1162-dcab-441a-873a-ecf994dcd133 tempest-AttachVolumeTestJSON-485250435 None] Lock "cinder-5f27abb4-b6a0-4d25-b866-b5618e5dd0dc-delete_volume" released by "delete_volume" :: held 0.655s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:30.510583 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:14:30.511498 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:30.556021 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:30.608280 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:37.604338 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-ceee0496-838c-4ef5-b367-ccab3557c6b0 req-ad623aec-c0a7-4556-a534-6d365e4e9495 tempest-VolumesBackupsTest-1343612709 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:14:38.619924 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-ceee0496-838c-4ef5-b367-ccab3557c6b0 req-ad623aec-c0a7-4556-a534-6d365e4e9495 tempest-VolumesBackupsTest-1343612709 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.015s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:14:38.621628 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-ceee0496-838c-4ef5-b367-ccab3557c6b0 req-ad623aec-c0a7-4556-a534-6d365e4e9495 tempest-VolumesBackupsTest-1343612709 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-52f315b5-455c-4987-8ca7-2e5d415d5ad2', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '52f315b5-455c-4987-8ca7-2e5d415d5ad2', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:14:38.662837 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-ceee0496-838c-4ef5-b367-ccab3557c6b0 req-ad623aec-c0a7-4556-a534-6d365e4e9495 tempest-VolumesBackupsTest-1343612709 None] Connection info returned from driver {'name': 'volumes/volume-52f315b5-455c-4987-8ca7-2e5d415d5ad2', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '52f315b5-455c-4987-8ca7-2e5d415d5ad2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e686e179-6f31-4de5-8697-df553ae4692a'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:14:38.770725 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-ceee0496-838c-4ef5-b367-ccab3557c6b0 req-ad623aec-c0a7-4556-a534-6d365e4e9495 tempest-VolumesBackupsTest-1343612709 None] attachment_update completed successfully. Oct 22 21:14:41.091798 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-3e2e0eb7-8184-4435-8813-e22da0bedee5 req-4c7096f6-d76c-4bb5-b3a3-f57b0c663858 tempest-TestVolumeBackupRestore-2071196610 None] Terminate volume connection completed successfully. Oct 22 21:14:41.093369 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-3e2e0eb7-8184-4435-8813-e22da0bedee5 req-4c7096f6-d76c-4bb5-b3a3-f57b0c663858 tempest-TestVolumeBackupRestore-2071196610 None] Deleting attachment 2985580a-0fc6-4173-bbfa-3c770c8529e4. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:14:41.241661 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-bba11914-43a2-4dc1-b4ad-34c84517d6d0 tempest-VolumesBackupsTest-1343612709 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-22T21:14:40Z,data_timestamp=2022-10-22T21:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-409527105',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=dec58fef-9241-48ac-a756-1dc3109a86da,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a25f382da0674f74ada627cf75ad37d0',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d25f7d1fb76e4eb5a8af45ff5d61efce',volume_id=52f315b5-455c-4987-8ca7-2e5d415d5ad2) Oct 22 21:14:41.243120 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.backup.rpcapi [None req-bba11914-43a2-4dc1-b4ad-34c84517d6d0 tempest-VolumesBackupsTest-1343612709 None] continue_backup in rpcapi backup_id dec58fef-9241-48ac-a756-1dc3109a86da {{(pid=131630) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Oct 22 21:14:41.485321 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-bba11914-43a2-4dc1-b4ad-34c84517d6d0 tempest-VolumesBackupsTest-1343612709 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:14:42.642759 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-bba11914-43a2-4dc1-b4ad-34c84517d6d0 tempest-VolumesBackupsTest-1343612709 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.157s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:14:42.644409 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bba11914-43a2-4dc1-b4ad-34c84517d6d0 tempest-VolumesBackupsTest-1343612709 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-52f315b5-455c-4987-8ca7-2e5d415d5ad2', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '52f315b5-455c-4987-8ca7-2e5d415d5ad2', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:14:42.682521 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-bba11914-43a2-4dc1-b4ad-34c84517d6d0 tempest-VolumesBackupsTest-1343612709 None] Initialize volume connection completed successfully. Oct 22 21:14:42.931606 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-82e016a8-3c01-4c25-bd35-a7c19b399c4b tempest-TestVolumeBackupRestore-2071196610 None] Acquiring lock "cinder-4678044e-7418-4ed6-afa9-88f7a689bd0c-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:42.957335 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-82e016a8-3c01-4c25-bd35-a7c19b399c4b tempest-TestVolumeBackupRestore-2071196610 None] Lock "cinder-4678044e-7418-4ed6-afa9-88f7a689bd0c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:43.035115 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-82e016a8-3c01-4c25-bd35-a7c19b399c4b tempest-TestVolumeBackupRestore-2071196610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:44.023546 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-82e016a8-3c01-4c25-bd35-a7c19b399c4b tempest-TestVolumeBackupRestore-2071196610 None] Volume volume-4678044e-7418-4ed6-afa9-88f7a689bd0c is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:44.054511 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-82e016a8-3c01-4c25-bd35-a7c19b399c4b tempest-TestVolumeBackupRestore-2071196610 None] deleting rbd volume volume-4678044e-7418-4ed6-afa9-88f7a689bd0c {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:44.065784 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] Acquiring lock "cinder-8dbcb5d7-299f-4798-9566-1f5ec03e2c40-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:44.078018 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] Lock "cinder-8dbcb5d7-299f-4798-9566-1f5ec03e2c40-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:44.124300 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:45.086046 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] deleting rbd volume volume-8dbcb5d7-299f-4798-9566-1f5ec03e2c40 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:45.172248 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-82e016a8-3c01-4c25-bd35-a7c19b399c4b tempest-TestVolumeBackupRestore-2071196610 None] Created reservations ['bf0c1beb-5c5c-495b-a0cf-ff39a3174983', '837294be-57ef-458a-9389-fa4e78c49ccd', '4e0e961a-e8b6-4cd3-bd5b-5852b2bd256e', '44c9c357-46dd-476d-b1eb-f39859385650'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:45.276767 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-82e016a8-3c01-4c25-bd35-a7c19b399c4b tempest-TestVolumeBackupRestore-2071196610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:45.346655 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-82e016a8-3c01-4c25-bd35-a7c19b399c4b tempest-TestVolumeBackupRestore-2071196610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:45.408420 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-82e016a8-3c01-4c25-bd35-a7c19b399c4b tempest-TestVolumeBackupRestore-2071196610 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:45.424950 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-82e016a8-3c01-4c25-bd35-a7c19b399c4b tempest-TestVolumeBackupRestore-2071196610 None] Deleted volume successfully. Oct 22 21:14:45.459130 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-bba11914-43a2-4dc1-b4ad-34c84517d6d0 tempest-VolumesBackupsTest-1343612709 None] Terminate volume connection completed successfully. Oct 22 21:14:45.462114 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-82e016a8-3c01-4c25-bd35-a7c19b399c4b tempest-TestVolumeBackupRestore-2071196610 None] Lock "cinder-4678044e-7418-4ed6-afa9-88f7a689bd0c-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:45.481162 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-bba11914-43a2-4dc1-b4ad-34c84517d6d0 tempest-VolumesBackupsTest-1343612709 None] Remove volume export completed successfully. Oct 22 21:14:45.506371 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:14:45.549955 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] deleting parent snapshot volume-8dbcb5d7-299f-4798-9566-1f5ec03e2c40.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:14:46.135727 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] Created reservations ['69088f0a-2794-4be9-b3f6-7760d7a5b836', 'a649c4fc-5b55-45a9-baa3-8d5338a908d9', 'c25f0542-ddea-4675-9ad9-6c11c111ba49', '95254500-6038-4879-8d44-b421bd6a691a'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:46.177557 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:INSERT=10,cinder:UPDATE=33,cinder:SELECT=55,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:46.186881 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:46.215983 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:46.250643 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:46.256227 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] Deleted volume successfully. Oct 22 21:14:46.269303 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2c8a6627-7e1e-411c-a76a-f37c640cf862 tempest-TestVolumeBackupRestore-2071196610 None] Lock "cinder-8dbcb5d7-299f-4798-9566-1f5ec03e2c40-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:48.867983 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-6384d683-af58-40fd-9c4b-ff1144f0065a req-b4323601-0de6-4dd9-b7f4-d9ab378d964f tempest-VolumesBackupsTest-1343612709 None] Terminate volume connection completed successfully. Oct 22 21:14:48.870200 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-6384d683-af58-40fd-9c4b-ff1144f0065a req-b4323601-0de6-4dd9-b7f4-d9ab378d964f tempest-VolumesBackupsTest-1343612709 None] Deleting attachment e686e179-6f31-4de5-8697-df553ae4692a. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:14:54.456581 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9bd8b1e5-1722-43f2-8980-92d992f5afd4 tempest-VolumesBackupsTest-1343612709 None] Acquiring lock "cinder-52f315b5-455c-4987-8ca7-2e5d415d5ad2-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:54.476670 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9bd8b1e5-1722-43f2-8980-92d992f5afd4 tempest-VolumesBackupsTest-1343612709 None] Lock "cinder-52f315b5-455c-4987-8ca7-2e5d415d5ad2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:54.512508 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=65,cinder:INSERT=5,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:14:54.556258 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9bd8b1e5-1722-43f2-8980-92d992f5afd4 tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:55.217631 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9bd8b1e5-1722-43f2-8980-92d992f5afd4 tempest-VolumesBackupsTest-1343612709 None] Volume volume-52f315b5-455c-4987-8ca7-2e5d415d5ad2 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:55.273820 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9bd8b1e5-1722-43f2-8980-92d992f5afd4 tempest-VolumesBackupsTest-1343612709 None] deleting rbd volume volume-52f315b5-455c-4987-8ca7-2e5d415d5ad2 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:14:55.815891 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-9bd8b1e5-1722-43f2-8980-92d992f5afd4 tempest-VolumesBackupsTest-1343612709 None] Created reservations ['cf4d22e2-9fe9-4721-a6a8-5ff371d6b2f3', 'c67a2e0b-33d9-4f62-8a14-6ea421fdd20c', '821713a4-c7ad-4b4a-a926-a09bc031b9e0', '58306158-a88c-44ed-a864-417b3fc73e7b'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:14:55.874002 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9bd8b1e5-1722-43f2-8980-92d992f5afd4 tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:55.927398 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9bd8b1e5-1722-43f2-8980-92d992f5afd4 tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:55.986692 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-9bd8b1e5-1722-43f2-8980-92d992f5afd4 tempest-VolumesBackupsTest-1343612709 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:14:55.992272 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9bd8b1e5-1722-43f2-8980-92d992f5afd4 tempest-VolumesBackupsTest-1343612709 None] Deleted volume successfully. Oct 22 21:14:56.020048 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-9bd8b1e5-1722-43f2-8980-92d992f5afd4 tempest-VolumesBackupsTest-1343612709 None] Lock "cinder-52f315b5-455c-4987-8ca7-2e5d415d5ad2-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:57.414561 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:14:57.438071 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Flow 'volume_create_manager' (e00eb4c2-c12c-477a-abe3-20b8dbb81f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:57.445530 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf447c1-597e-4e20-a5fc-a5db650f32d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:57.464576 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf447c1-597e-4e20-a5fc-a5db650f32d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1852771691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a983bd43-d759-4820-9793-24462f8f4c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a25f382da0674f74ada627cf75ad37d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:14:57Z,use_quota=True,user_id='d25f7d1fb76e4eb5a8af45ff5d61efce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:57.470195 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb71f807-2ff2-4cbe-afa9-ae25382b60ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:57.474831 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb71f807-2ff2-4cbe-afa9-ae25382b60ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:57.480973 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720a1ed0-8281-4c8e-a3b6-d880bae5307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:57.633804 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720a1ed0-8281-4c8e-a3b6-d880bae5307a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a983bd43-d759-4820-9793-24462f8f4c7b', 'volume_name': 'volume-a983bd43-d759-4820-9793-24462f8f4c7b', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:57.638777 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2277c43a-7c14-4874-95d8-0af651776106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:57.643068 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2277c43a-7c14-4874-95d8-0af651776106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:57.648209 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61db0313-8250-4c19-b424-c893e49c19fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:57.649623 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Volume a983bd43-d759-4820-9793-24462f8f4c7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a983bd43-d759-4820-9793-24462f8f4c7b', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 21:14:57.650433 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Cloning a983bd43-d759-4820-9793-24462f8f4c7b from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 21:14:57.651370 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:14:57.665102 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:14:57.682628 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 14, 57, 670386)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:14:57.686044 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:14:57.686820 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 21:14:57.692521 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.027s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:14:57.694527 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 21:14:57.708168 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 14, 57, 701830)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:14:57.709924 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:14:57.710589 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 21:14:57.735524 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:14:57.842372 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] creating snapshot='volume-a983bd43-d759-4820-9793-24462f8f4c7b.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:14:58.056168 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-a983bd43-d759-4820-9793-24462f8f4c7b.clone_snap' to 'volume-a983bd43-d759-4820-9793-24462f8f4c7b' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:14:58.198169 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:14:58.199654 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:14:58.200585 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:14:58.232039 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:14:58.232752 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Marking volume a983bd43-d759-4820-9793-24462f8f4c7b as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:14:58.241172 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to a983bd43-d759-4820-9793-24462f8f4c7b. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 21:14:58.243913 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Creating volume glance metadata for volume a983bd43-d759-4820-9793-24462f8f4c7b backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 21:14:58.332553 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61db0313-8250-4c19-b424-c893e49c19fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a983bd43-d759-4820-9793-24462f8f4c7b', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:58.343451 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4db989c-94b5-4c74-bcce-cc60eb7810ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:14:58.366268 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Volume volume-a983bd43-d759-4820-9793-24462f8f4c7b (a983bd43-d759-4820-9793-24462f8f4c7b): created successfully Oct 22 21:14:58.369818 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4db989c-94b5-4c74-bcce-cc60eb7810ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:14:58.382563 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Flow 'volume_create_manager' (e00eb4c2-c12c-477a-abe3-20b8dbb81f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:14:58.396034 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5331ba3e-a6cc-46e4-9253-b84bdb5d4e40 tempest-VolumesBackupsTest-1343612709 None] Created volume successfully. Oct 22 21:14:58.851764 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-210537ee-6784-401a-8aa4-17e76c4bfe69 tempest-VolumesBackupsTest-1343612709 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-22T21:14:58Z,data_timestamp=2022-10-22T21:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-252359329',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=03efe8bc-22a7-48d2-9da5-8199313f36e7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a25f382da0674f74ada627cf75ad37d0',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d25f7d1fb76e4eb5a8af45ff5d61efce',volume_id=a983bd43-d759-4820-9793-24462f8f4c7b) Oct 22 21:14:58.853361 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.backup.rpcapi [None req-210537ee-6784-401a-8aa4-17e76c4bfe69 tempest-VolumesBackupsTest-1343612709 None] continue_backup in rpcapi backup_id 03efe8bc-22a7-48d2-9da5-8199313f36e7 {{(pid=131630) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Oct 22 21:14:58.942649 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-210537ee-6784-401a-8aa4-17e76c4bfe69 tempest-VolumesBackupsTest-1343612709 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:14:59.689334 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-210537ee-6784-401a-8aa4-17e76c4bfe69 tempest-VolumesBackupsTest-1343612709 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.746s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:14:59.690449 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-210537ee-6784-401a-8aa4-17e76c4bfe69 tempest-VolumesBackupsTest-1343612709 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a983bd43-d759-4820-9793-24462f8f4c7b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'a983bd43-d759-4820-9793-24462f8f4c7b', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:14:59.711225 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-210537ee-6784-401a-8aa4-17e76c4bfe69 tempest-VolumesBackupsTest-1343612709 None] Initialize volume connection completed successfully. Oct 22 21:15:06.366361 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-210537ee-6784-401a-8aa4-17e76c4bfe69 tempest-VolumesBackupsTest-1343612709 None] Terminate volume connection completed successfully. Oct 22 21:15:06.385809 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-210537ee-6784-401a-8aa4-17e76c4bfe69 tempest-VolumesBackupsTest-1343612709 None] Remove volume export completed successfully. Oct 22 21:15:07.509664 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:15:07.531077 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Flow 'volume_create_manager' (21ab92fc-6a28-47dd-b619-8f550f05516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:15:07.537596 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d2fe28-6b6f-489c-a5f1-230fb69dca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:15:07.554087 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d2fe28-6b6f-489c-a5f1-230fb69dca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:15:07Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_03efe8bc-22a7-48d2-9da5-8199313f36e7',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=410edfa5-5397-4932-a574-ca48f003ddfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a25f382da0674f74ada627cf75ad37d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:15:07Z,use_quota=True,user_id='d25f7d1fb76e4eb5a8af45ff5d61efce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:15:07.559050 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efeecdc8-e0aa-46f6-a88b-63d6b0846c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:15:07.563142 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efeecdc8-e0aa-46f6-a88b-63d6b0846c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:15:07.567982 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a78d2fe-e308-4ea5-8ff0-372d85adeb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:15:07.571872 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a78d2fe-e308-4ea5-8ff0-372d85adeb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '410edfa5-5397-4932-a574-ca48f003ddfc', 'volume_name': 'volume-410edfa5-5397-4932-a574-ca48f003ddfc', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:15:07.576430 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4638e2-e2b0-418a-a236-7a60652c0f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:15:07.580277 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4638e2-e2b0-418a-a236-7a60652c0f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:15:07.584986 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1592834-9369-4186-8c2f-60bd0cd7518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:15:07.586088 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Volume 410edfa5-5397-4932-a574-ca48f003ddfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-410edfa5-5397-4932-a574-ca48f003ddfc', 'volume_size': 1} Oct 22 21:15:07.586439 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] creating volume 'volume-410edfa5-5397-4932-a574-ca48f003ddfc' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:15:07.587601 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:07.656159 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:15:07.656544 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:15:07.660075 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1592834-9369-4186-8c2f-60bd0cd7518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410edfa5-5397-4932-a574-ca48f003ddfc', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:15:07.664993 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4308c2-037a-46d1-9a63-098b2fc2f03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:15:07.676079 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Volume volume-410edfa5-5397-4932-a574-ca48f003ddfc (410edfa5-5397-4932-a574-ca48f003ddfc): created successfully Oct 22 21:15:07.680031 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4308c2-037a-46d1-9a63-098b2fc2f03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:15:07.685780 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Flow 'volume_create_manager' (21ab92fc-6a28-47dd-b619-8f550f05516f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:15:07.693599 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Created volume successfully. Oct 22 21:15:08.555939 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:15:09.307683 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.751s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:15:09.308536 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-410edfa5-5397-4932-a574-ca48f003ddfc', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '410edfa5-5397-4932-a574-ca48f003ddfc', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:15:09.334570 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Initialize volume connection completed successfully. Oct 22 21:15:14.534078 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Terminate volume connection completed successfully. Oct 22 21:15:14.553733 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6ea7a2b6-484e-4ef8-9920-27d2dda31347 tempest-VolumesBackupsTest-1343612709 None] Remove volume export completed successfully. Oct 22 21:15:15.036407 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c74a104d-a3ba-407c-8c30-10f58767e378 tempest-VolumesBackupsTest-1343612709 None] Acquiring lock "cinder-410edfa5-5397-4932-a574-ca48f003ddfc-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:15:15.068751 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c74a104d-a3ba-407c-8c30-10f58767e378 tempest-VolumesBackupsTest-1343612709 None] Lock "cinder-410edfa5-5397-4932-a574-ca48f003ddfc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:15:15.136831 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c74a104d-a3ba-407c-8c30-10f58767e378 tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:16.189573 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c74a104d-a3ba-407c-8c30-10f58767e378 tempest-VolumesBackupsTest-1343612709 None] Volume volume-410edfa5-5397-4932-a574-ca48f003ddfc is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:15:16.214328 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c74a104d-a3ba-407c-8c30-10f58767e378 tempest-VolumesBackupsTest-1343612709 None] deleting rbd volume volume-410edfa5-5397-4932-a574-ca48f003ddfc {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:15:16.893767 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=58,cinder:UPDATE=13,cinder:INSERT=6,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:16.948148 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-c74a104d-a3ba-407c-8c30-10f58767e378 tempest-VolumesBackupsTest-1343612709 None] Created reservations ['f8cc11f7-12d9-4b01-beae-5c02941803e2', '00e5bd6b-fc11-4740-8b06-3284dfdc07e1', '9ade7e5c-e313-43e0-bfa6-9af9fef940f1', 'f9ee2f2e-9c9b-4251-9dc1-a60aa5105024'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:15:17.003855 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c74a104d-a3ba-407c-8c30-10f58767e378 tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:17.069014 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c74a104d-a3ba-407c-8c30-10f58767e378 tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:17.151204 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-c74a104d-a3ba-407c-8c30-10f58767e378 tempest-VolumesBackupsTest-1343612709 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:15:17.156369 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c74a104d-a3ba-407c-8c30-10f58767e378 tempest-VolumesBackupsTest-1343612709 None] Deleted volume successfully. Oct 22 21:15:17.175193 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c74a104d-a3ba-407c-8c30-10f58767e378 tempest-VolumesBackupsTest-1343612709 None] Lock "cinder-410edfa5-5397-4932-a574-ca48f003ddfc-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:15:17.190103 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] Acquiring lock "cinder-cd8c9d9a-c8b6-4103-804b-d25128f1cb17-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:15:17.210023 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] Lock "cinder-cd8c9d9a-c8b6-4103-804b-d25128f1cb17-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:15:17.248710 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=59,cinder:INSERT=14,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:17.253430 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:17.325392 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:15:17.325836 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] Volume volume-cd8c9d9a-c8b6-4103-804b-d25128f1cb17 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:15:17.336164 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] deleting rbd volume volume-cd8c9d9a-c8b6-4103-804b-d25128f1cb17 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:15:17.566714 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] Created reservations ['b09942bd-67b2-41e0-a8f1-c30099e69037', 'dbcd952c-84a1-430e-95b2-6e95598d7000', '0902fb41-e30c-4877-9f85-44b9a1d1229c', '441c50af-5258-433b-848b-87fea3c3df0a'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:15:17.624010 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:17.671084 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:17.707145 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:15:17.711943 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] Deleted volume successfully. Oct 22 21:15:17.727564 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-26890c8b-7038-4bb2-bab0-591486ff8195 tempest-AttachVolumeShelveTestJSON-1454811106 None] Lock "cinder-cd8c9d9a-c8b6-4103-804b-d25128f1cb17-delete_volume" released by "delete_volume" :: held 0.517s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:15:18.517209 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] Acquiring lock "cinder-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:15:18.530023 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] Lock "cinder-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:15:18.575859 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:18.637351 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:15:18.637986 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] Volume volume-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:15:18.657158 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] deleting rbd volume volume-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:15:18.938547 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] Created reservations ['72189ac9-7a92-4de0-b882-141d6d7e385b', '84302392-b832-4b28-958a-c8b4ce786008', 'a8d5e23a-bd1c-4eb1-8cf4-e69edaee36b1', '0ea189bc-5e2a-4590-9461-e48d4d92c139'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:15:18.991796 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:19.045907 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:19.095721 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:15:19.102262 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] Deleted volume successfully. Oct 22 21:15:19.124544 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a4a9e757-be07-44f0-a776-0e3db2c9f09d tempest-AttachVolumeShelveTestJSON-1454811106 None] Lock "cinder-c67610e1-af2e-402f-8cee-c3d2c0eb9bfd-delete_volume" released by "delete_volume" :: held 0.594s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:15:19.622869 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] Acquiring lock "cinder-a983bd43-d759-4820-9793-24462f8f4c7b-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:15:19.642018 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] Lock "cinder-a983bd43-d759-4820-9793-24462f8f4c7b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:15:19.713613 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:20.307095 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] deleting rbd volume volume-a983bd43-d759-4820-9793-24462f8f4c7b {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:15:20.599556 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:15:20.652970 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] deleting parent snapshot volume-a983bd43-d759-4820-9793-24462f8f4c7b.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:15:21.396340 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] Created reservations ['4eff309e-0420-4303-884b-1ec7dd9dc930', 'feb4a1d6-3abb-4e8a-a874-04e2ea06a511', '16fa03f1-29b3-45fb-9237-033f1ad02050', '969f26bf-5d91-427d-9516-98dd543595c9'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:15:21.471731 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:21.524010 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:21.575304 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:15:21.586783 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] Deleted volume successfully. Oct 22 21:15:21.608860 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-939eccc9-00ae-4477-822b-3ffa8480de44 tempest-VolumesBackupsTest-1343612709 None] Lock "cinder-a983bd43-d759-4820-9793-24462f8f4c7b-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:15:23.265416 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-43df6f60-6f18-4fa5-95e4-919639f71571 req-9e9deade-d506-4dd1-9b0c-318224ee065a tempest-TestVolumeBootPattern-1443368191 None] Terminate volume connection completed successfully. Oct 22 21:15:23.265989 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-43df6f60-6f18-4fa5-95e4-919639f71571 req-9e9deade-d506-4dd1-9b0c-318224ee065a tempest-TestVolumeBootPattern-1443368191 None] Deleting attachment 992335b0-0ac0-437d-914d-ec8ff00c1e5c. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:15:25.166944 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-04ac9161-c0dc-449d-bc14-77798e1235cb tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-b2b053a3-6082-4ecb-aa86-9bc2e5608d19-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:15:25.190294 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-04ac9161-c0dc-449d-bc14-77798e1235cb tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-b2b053a3-6082-4ecb-aa86-9bc2e5608d19-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:15:25.289378 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-04ac9161-c0dc-449d-bc14-77798e1235cb tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:25.489107 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-04ac9161-c0dc-449d-bc14-77798e1235cb tempest-TestVolumeBootPattern-1443368191 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:15:25.500551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-04ac9161-c0dc-449d-bc14-77798e1235cb tempest-TestVolumeBootPattern-1443368191 None] deleting rbd volume volume-b2b053a3-6082-4ecb-aa86-9bc2e5608d19 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:15:25.823376 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-04ac9161-c0dc-449d-bc14-77798e1235cb tempest-TestVolumeBootPattern-1443368191 None] Created reservations ['af55e49f-eec0-40f0-a006-2e7076088dc6', '9c2c392f-1ddf-4aa0-98fb-141ef930afbf', '433263f3-507c-435e-bb44-caf018c1b56c', 'ca12c788-3299-4683-8d2f-8639851d6db8'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:15:25.875409 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-04ac9161-c0dc-449d-bc14-77798e1235cb tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:25.923451 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-04ac9161-c0dc-449d-bc14-77798e1235cb tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:25.998260 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-04ac9161-c0dc-449d-bc14-77798e1235cb tempest-TestVolumeBootPattern-1443368191 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:15:26.002590 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-04ac9161-c0dc-449d-bc14-77798e1235cb tempest-TestVolumeBootPattern-1443368191 None] Deleted volume successfully. Oct 22 21:15:26.025309 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-04ac9161-c0dc-449d-bc14-77798e1235cb tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-b2b053a3-6082-4ecb-aa86-9bc2e5608d19-delete_volume" released by "delete_volume" :: held 0.833s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:15:26.445976 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8cca6d99-2509-4bd6-a7b5-5413e96fca2d tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-023fa692-c7d4-402a-9884-7be43ebed8c6-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:15:26.463245 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8cca6d99-2509-4bd6-a7b5-5413e96fca2d tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-023fa692-c7d4-402a-9884-7be43ebed8c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:15:26.466160 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8cca6d99-2509-4bd6-a7b5-5413e96fca2d tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:30.513762 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:15:30.514581 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:30.540634 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:15:30.572067 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:15:36.006501 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=53,cinder:UPDATE=38,cinder:INSERT=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:36.907469 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=53,cinder:INSERT=9,cinder:UPDATE=34,cinder:DELETE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:46.924461 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:15:56.733709 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-8cca6d99-2509-4bd6-a7b5-5413e96fca2d tempest-TestVolumeBootPattern-1443368191 None] Created reservations ['5bc73cca-ff74-4d03-999b-fb40e69866fe', '112c553f-9b51-41b6-b66e-c11ed89d6dbb', 'bf4a12aa-9ca1-47b4-a0b2-922e36e9980d', '51f6176b-229f-4bb3-b769-b07e2f2755f7'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:15:56.803976 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8cca6d99-2509-4bd6-a7b5-5413e96fca2d tempest-TestVolumeBootPattern-1443368191 None] Delete snapshot completed successfully. Oct 22 21:15:56.828633 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8cca6d99-2509-4bd6-a7b5-5413e96fca2d tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-023fa692-c7d4-402a-9884-7be43ebed8c6-delete_snapshot" released by "delete_snapshot" :: held 30.365s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:16:00.717270 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-f3688c1f-9690-4413-92b1-34b2e716d8b2 req-124471e2-5874-4411-8b89-8db58424a413 tempest-TaggedBootDevicesTest-288730008 None] Terminate volume connection completed successfully. Oct 22 21:16:00.717983 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f3688c1f-9690-4413-92b1-34b2e716d8b2 req-124471e2-5874-4411-8b89-8db58424a413 tempest-TaggedBootDevicesTest-288730008 None] Deleting attachment 12343f0e-5af4-436b-a3bb-de6b0509690c. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:16:01.024008 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-f3688c1f-9690-4413-92b1-34b2e716d8b2 req-c02d2a98-e779-4cc0-9383-85191b61e7ac tempest-TaggedBootDevicesTest-288730008 None] Terminate volume connection completed successfully. Oct 22 21:16:01.024426 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f3688c1f-9690-4413-92b1-34b2e716d8b2 req-c02d2a98-e779-4cc0-9383-85191b61e7ac tempest-TaggedBootDevicesTest-288730008 None] Deleting attachment f1ccae1f-075a-4947-bb43-abea414ba9f7. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:16:01.255463 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-f3688c1f-9690-4413-92b1-34b2e716d8b2 req-2e712377-17f9-4aed-8897-71dc8284f29c tempest-TaggedBootDevicesTest-288730008 None] Terminate volume connection completed successfully. Oct 22 21:16:01.255896 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-f3688c1f-9690-4413-92b1-34b2e716d8b2 req-2e712377-17f9-4aed-8897-71dc8284f29c tempest-TaggedBootDevicesTest-288730008 None] Deleting attachment 7563858f-60af-4998-a9cc-b018157c3591. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:16:04.780407 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-63cb9422-1981-4aa9-ae21-dd491899eac7 req-752985f1-f346-44b3-b3bb-63fcd4fa348e tempest-TestVolumeBootPattern-1443368191 None] Terminate volume connection completed successfully. Oct 22 21:16:04.780944 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-63cb9422-1981-4aa9-ae21-dd491899eac7 req-752985f1-f346-44b3-b3bb-63fcd4fa348e tempest-TestVolumeBootPattern-1443368191 None] Deleting attachment 7751d639-0322-46de-9976-e6e824658d84. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:16:07.670036 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] Acquiring lock "cinder-636027aa-4bd0-4937-b625-4929d9464061-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:16:07.693653 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-636027aa-4bd0-4937-b625-4929d9464061-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:16:07.698865 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=27,cinder:UPDATE=8,cinder:INSERT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:07.758365 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:07.868899 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:16:07.888279 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] deleting rbd volume volume-636027aa-4bd0-4937-b625-4929d9464061 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:16:08.344832 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:16:08.377935 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] deleting parent snapshot volume-636027aa-4bd0-4937-b625-4929d9464061.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:16:09.500880 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] Acquiring lock "cinder-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:16:09.562275 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] Lock "cinder-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:16:09.649613 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] Created reservations ['0f16f9f3-93b5-4551-9323-eae8fac9501c', '6f1c7f1f-0b90-4e2d-8b33-f8620c886059', '0c5c6066-9969-40df-b218-98ddf60ecf43', '71a029ff-c240-4f2a-b74e-1ffafb4240ee'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:16:09.689311 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:09.772451 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:16:09.773043 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] Volume volume-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:16:09.789242 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] deleting rbd volume volume-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:16:09.841048 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:09.949091 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:10.036342 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:16:10.047124 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] Deleted volume successfully. Oct 22 21:16:10.081144 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a34758d1-348f-4164-8749-260b32a23542 tempest-TestVolumeBootPattern-1443368191 None] Lock "cinder-636027aa-4bd0-4937-b625-4929d9464061-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:16:10.265730 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] Created reservations ['96c1fe5f-9569-4b7c-aa65-9947b50a9480', 'aeadbed3-f626-433f-85d8-0a1c5cdd17ac', '4fcabb29-934d-4fe1-94fd-d51d8490ae13', '12801f08-c14d-4211-8eaf-3e7852b630a8'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:16:10.344784 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:10.435564 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:10.510022 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:16:10.518808 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] Acquiring lock "cinder-d741aba9-6d17-41ea-aedf-8915327ec92f-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:16:10.522593 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] Deleted volume successfully. Oct 22 21:16:10.537223 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] Lock "cinder-d741aba9-6d17-41ea-aedf-8915327ec92f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:16:10.560192 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e4a557f5-5141-42a1-84bf-45c43a4be63f tempest-TaggedBootDevicesTest-288730008 None] Lock "cinder-0f2ae7f9-0c2d-4ec8-abb0-5a3968c88eb4-delete_volume" released by "delete_volume" :: held 0.998s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:16:10.595948 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:10.676508 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:16:10.676939 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] Volume volume-d741aba9-6d17-41ea-aedf-8915327ec92f is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:16:10.685826 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] deleting rbd volume volume-d741aba9-6d17-41ea-aedf-8915327ec92f {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:16:11.068087 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] Created reservations ['6a21c25e-4b1e-4184-a1b9-7a3a8a89f0ad', 'dac620b5-8563-41e9-86ac-1dffe11a7017', 'b858525c-9d8f-42a8-96a4-fd03d74d8ece', 'd56223fd-c230-4c52-bda0-289bc0db371c'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:16:11.181392 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:11.262705 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:11.300280 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:16:11.304756 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] Deleted volume successfully. Oct 22 21:16:11.323061 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-894e4d5f-83e3-4194-9015-82d5399f41cd tempest-TaggedBootDevicesTest-288730008 None] Lock "cinder-d741aba9-6d17-41ea-aedf-8915327ec92f-delete_volume" released by "delete_volume" :: held 0.786s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:16:11.678825 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] Acquiring lock "cinder-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:16:11.705297 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] Lock "cinder-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:16:11.767063 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:11.888547 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:16:11.910304 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] deleting rbd volume volume-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:16:12.258173 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:16:12.292761 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] deleting parent snapshot volume-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:16:12.481094 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=59,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:12.539539 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] Created reservations ['0816f3f0-c097-4df0-90a6-0d481b47314a', '137b7d54-9506-49ef-ad4d-36a11d35ef28', 'c406e18f-4f60-4405-a2e6-f021e621db6b', 'd2b3dfec-f2ca-4d4e-968e-b4e7155a5d4d'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:16:12.656332 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:12.735828 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:12.832116 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:16:12.842455 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] Deleted volume successfully. Oct 22 21:16:12.862912 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d7976b60-0cff-42ac-8697-293066b021dd tempest-TaggedBootDevicesTest-288730008 None] Lock "cinder-af9a7f61-9e74-4d62-8f44-7bb6c43f3d57-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:16:30.512084 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:16:30.512750 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:30.606455 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:16:30.724142 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:16:36.916882 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=54,cinder:INSERT=9,cinder:UPDATE=34 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:16:46.930808 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:06.918826 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:16.911494 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:30.511183 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:17:30.513356 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:30.573607 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:30.616528 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:17:36.917250 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:46.924847 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:50.167563 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-96a03c42-f260-450e-8a28-3f240d6346bb tempest-GroupSnapshotsTest-1098440790 None] Group tempest-GroupSnapshotsTest-Group-452471849: creating Oct 22 21:17:50.194391 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-96a03c42-f260-450e-8a28-3f240d6346bb tempest-GroupSnapshotsTest-1098440790 None] Group tempest-GroupSnapshotsTest-Group-452471849: created successfully Oct 22 21:17:50.216481 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-96a03c42-f260-450e-8a28-3f240d6346bb tempest-GroupSnapshotsTest-1098440790 None] Create group completed successfully. Oct 22 21:17:51.699371 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:17:51.730552 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Flow 'volume_create_manager' (c8e65ade-1a0b-4e37-84b8-e31b349a2dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:17:51.742171 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2baa4c4a-d87c-4f9f-82b8-96e28100f124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:17:51.772308 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2baa4c4a-d87c-4f9f-82b8-96e28100f124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1322269407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38ca37a2-5094-4b39-9b12-8ca5d1f45f76,host='ncdv-master-1@ceph#ceph',id=84a5038a-4d73-4eb3-a33c-25467e6921b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca9901d03124914bf282ea0cfa731f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:17:52Z,use_quota=True,user_id='2ce2e2785d3e4aa8b1870eb7044fa2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(611a52d2-ee2c-4f9a-bc8b-af048ba39bb2),volume_type_id=611a52d2-ee2c-4f9a-bc8b-af048ba39bb2)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:17:51.778462 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc633196-d032-4c00-bc9c-540ab87898c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:17:51.782924 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc633196-d032-4c00-bc9c-540ab87898c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:17:51.788251 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3794131-5b30-4be7-85c1-dea0670e1fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:17:51.793901 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3794131-5b30-4be7-85c1-dea0670e1fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a5038a-4d73-4eb3-a33c-25467e6921b1', 'volume_name': 'volume-84a5038a-4d73-4eb3-a33c-25467e6921b1', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:17:51.802098 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7852d93-6283-4a9e-bc5d-7e73e3d615e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:17:51.806911 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7852d93-6283-4a9e-bc5d-7e73e3d615e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:17:51.811333 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33d7b7a-ee22-4d2f-a2c2-5c2b7694a39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:17:51.812569 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Volume 84a5038a-4d73-4eb3-a33c-25467e6921b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a5038a-4d73-4eb3-a33c-25467e6921b1', 'volume_size': 1} Oct 22 21:17:51.812965 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] creating volume 'volume-84a5038a-4d73-4eb3-a33c-25467e6921b1' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:17:51.813919 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:51.906375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:17:51.906375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:17:51.906375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33d7b7a-ee22-4d2f-a2c2-5c2b7694a39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a5038a-4d73-4eb3-a33c-25467e6921b1', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:17:51.910744 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cf4781-c2c4-4e24-931f-f83cb49d147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:17:51.922824 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Volume volume-84a5038a-4d73-4eb3-a33c-25467e6921b1 (84a5038a-4d73-4eb3-a33c-25467e6921b1): created successfully Oct 22 21:17:51.926823 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cf4781-c2c4-4e24-931f-f83cb49d147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:17:51.932505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Flow 'volume_create_manager' (c8e65ade-1a0b-4e37-84b8-e31b349a2dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:17:51.942395 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-06c2a4c0-fac2-499a-9bed-3912909f2134 tempest-GroupSnapshotsTest-1098440790 None] Created volume successfully. Oct 22 21:17:52.998524 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4199a07c-bafc-4bca-9b37-d0392e64b29f tempest-GroupSnapshotsTest-1098440790 None] GroupSnapshot b2a4da8d-646b-4209-9838-8a8991ab922b: creating. Oct 22 21:17:53.023024 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4199a07c-bafc-4bca-9b37-d0392e64b29f tempest-GroupSnapshotsTest-1098440790 None] Group snapshot b2a4da8d-646b-4209-9838-8a8991ab922b: creating. {{(pid=131630) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}} Oct 22 21:17:53.049215 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4199a07c-bafc-4bca-9b37-d0392e64b29f tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:53.608218 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4199a07c-bafc-4bca-9b37-d0392e64b29f tempest-GroupSnapshotsTest-1098440790 None] group_snapshot b2a4da8d-646b-4209-9838-8a8991ab922b: created successfully Oct 22 21:17:54.725316 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cfbb3f5c-77c4-4baf-bafd-a4d79c2c3bdc tempest-GroupSnapshotsTest-1098440790 None] cloning volumes/volume-84a5038a-4d73-4eb3-a33c-25467e6921b1@snapshot-3615fc40-f8d4-4669-bf02-b05f6303bd30 to volume-ca21e88e-33d6-4a99-a131-58bedbd6b0cc {{(pid=131630) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}} Oct 22 21:17:54.727194 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cfbb3f5c-77c4-4baf-bafd-a4d79c2c3bdc tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:54.788709 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cfbb3f5c-77c4-4baf-bafd-a4d79c2c3bdc tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:54.956046 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cfbb3f5c-77c4-4baf-bafd-a4d79c2c3bdc tempest-GroupSnapshotsTest-1098440790 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:17:54.956654 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cfbb3f5c-77c4-4baf-bafd-a4d79c2c3bdc tempest-GroupSnapshotsTest-1098440790 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:17:55.027505 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-cfbb3f5c-77c4-4baf-bafd-a4d79c2c3bdc tempest-GroupSnapshotsTest-1098440790 None] Create group from source-snapshot-b2a4da8d-646b-4209-9838-8a8991ab922b completed successfully. Oct 22 21:17:56.402094 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fdab0eac-7041-4f48-bce3-8c252b615c6a tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:56.490797 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fdab0eac-7041-4f48-bce3-8c252b615c6a tempest-GroupSnapshotsTest-1098440790 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:17:56.498013 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fdab0eac-7041-4f48-bce3-8c252b615c6a tempest-GroupSnapshotsTest-1098440790 None] deleting rbd volume volume-ca21e88e-33d6-4a99-a131-58bedbd6b0cc {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:17:56.778568 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-fdab0eac-7041-4f48-bce3-8c252b615c6a tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['9a6f91f1-70f0-454e-b5d4-0ba041c31d17'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:17:56.810801 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-fdab0eac-7041-4f48-bce3-8c252b615c6a tempest-GroupSnapshotsTest-1098440790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1037542478 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1037542478, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:17:56.811938 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-fdab0eac-7041-4f48-bce3-8c252b615c6a tempest-GroupSnapshotsTest-1098440790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1037542478 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1037542478, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:17:56.833059 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-fdab0eac-7041-4f48-bce3-8c252b615c6a tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['94c52b24-1793-4259-8e68-78a15d5a284d', 'd1b8ccf3-b417-464b-a615-20a287b81b44', 'ea1f1da3-4dc0-4805-9c3c-f1c711c6f647', '65f14b3f-fb75-4e7d-995f-61c903e32d6f'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:17:56.966903 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fdab0eac-7041-4f48-bce3-8c252b615c6a tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:57.002244 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fdab0eac-7041-4f48-bce3-8c252b615c6a tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:57.045998 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-fdab0eac-7041-4f48-bce3-8c252b615c6a tempest-GroupSnapshotsTest-1098440790 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:17:57.050653 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-fdab0eac-7041-4f48-bce3-8c252b615c6a tempest-GroupSnapshotsTest-1098440790 None] Delete group completed successfully. Oct 22 21:17:57.632400 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-355e5866-e86d-4d72-b5e9-b16602e2bc28 tempest-GroupSnapshotsTest-1098440790 None] group_snapshot b2a4da8d-646b-4209-9838-8a8991ab922b: deleting Oct 22 21:17:57.669254 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-355e5866-e86d-4d72-b5e9-b16602e2bc28 tempest-GroupSnapshotsTest-1098440790 None] group_snapshot b2a4da8d-646b-4209-9838-8a8991ab922b: deleting {{(pid=131630) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}} Oct 22 21:17:57.690025 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-355e5866-e86d-4d72-b5e9-b16602e2bc28 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:58.628090 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-355e5866-e86d-4d72-b5e9-b16602e2bc28 tempest-GroupSnapshotsTest-1098440790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1037542478 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1037542478, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:17:58.663587 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-355e5866-e86d-4d72-b5e9-b16602e2bc28 tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['1388680e-9477-4025-9757-c7537fcadfbc', 'eff261ea-4da8-428e-9753-2b0a2d8769e7', '6ae8e7a9-4a35-4e27-b62e-70ca62bf408d', '292943be-e502-4dcb-9bfe-2b2854332b28'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:17:58.732830 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=74,cinder:UPDATE=21,cinder:INSERT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:58.771767 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-355e5866-e86d-4d72-b5e9-b16602e2bc28 tempest-GroupSnapshotsTest-1098440790 None] group_snapshot b2a4da8d-646b-4209-9838-8a8991ab922b: deleted successfully Oct 22 21:17:59.171968 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-82e5d5b3-1594-4b99-bf8f-5b0411896982 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:59.247634 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-82e5d5b3-1594-4b99-bf8f-5b0411896982 tempest-GroupSnapshotsTest-1098440790 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:17:59.248079 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-82e5d5b3-1594-4b99-bf8f-5b0411896982 tempest-GroupSnapshotsTest-1098440790 None] Volume volume-84a5038a-4d73-4eb3-a33c-25467e6921b1 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:17:59.254504 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-82e5d5b3-1594-4b99-bf8f-5b0411896982 tempest-GroupSnapshotsTest-1098440790 None] deleting rbd volume volume-84a5038a-4d73-4eb3-a33c-25467e6921b1 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:17:59.514952 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-82e5d5b3-1594-4b99-bf8f-5b0411896982 tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['704737c9-a264-4b58-9373-7d64fd2c3808'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:17:59.517874 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=66,cinder:UPDATE=29,cinder:DELETE=1,cinder:INSERT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:17:59.556336 ncdv-master-1 cinder-volume[131630]: WARNING cinder.db.sqlalchemy.api [None req-82e5d5b3-1594-4b99-bf8f-5b0411896982 tempest-GroupSnapshotsTest-1098440790 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1037542478'] Oct 22 21:17:59.564901 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-82e5d5b3-1594-4b99-bf8f-5b0411896982 tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['4ef6002a-c915-44e9-afc7-a77c3175d369', 'e32b41f4-48e0-413a-a6d7-cb6223452abb', '585d1901-ead0-4915-aa85-98299a391d02', '11c988df-12a8-410a-aff5-edb83d603f39'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:17:59.694880 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-82e5d5b3-1594-4b99-bf8f-5b0411896982 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:59.790405 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-82e5d5b3-1594-4b99-bf8f-5b0411896982 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:17:59.858417 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-82e5d5b3-1594-4b99-bf8f-5b0411896982 tempest-GroupSnapshotsTest-1098440790 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:17:59.869688 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-82e5d5b3-1594-4b99-bf8f-5b0411896982 tempest-GroupSnapshotsTest-1098440790 None] Delete group completed successfully. Oct 22 21:18:00.764379 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-53741c08-eb7c-4b47-a846-e98c07097212 tempest-GroupSnapshotsTest-1098440790 None] Group tempest-GroupSnapshotsTest-Group-980800129: creating Oct 22 21:18:00.793164 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-53741c08-eb7c-4b47-a846-e98c07097212 tempest-GroupSnapshotsTest-1098440790 None] Group tempest-GroupSnapshotsTest-Group-980800129: created successfully Oct 22 21:18:00.829175 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-53741c08-eb7c-4b47-a846-e98c07097212 tempest-GroupSnapshotsTest-1098440790 None] Create group completed successfully. Oct 22 21:18:01.059120 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:18:01.079769 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Flow 'volume_create_manager' (06c71971-c860-47c2-9012-38b7c17eb0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:01.086190 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fba608f-cb0b-4071-af1f-0a9a1d4b8591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:01.102487 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fba608f-cb0b-4071-af1f-0a9a1d4b8591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-484692999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3eaddf40-8188-4b1b-980a-3be0b9b0e509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af724189a24022b3ef7651b7157a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:18:01Z,use_quota=True,user_id='6c8a9229e7da421b9e0e6f7df52f71e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:01.107966 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba26f65-ebe5-4441-b18d-21627dab2a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:01.112063 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba26f65-ebe5-4441-b18d-21627dab2a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:01.116940 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764f338c-d56c-48a5-a3ba-30e1a1fe349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:01.120958 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764f338c-d56c-48a5-a3ba-30e1a1fe349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eaddf40-8188-4b1b-980a-3be0b9b0e509', 'volume_name': 'volume-3eaddf40-8188-4b1b-980a-3be0b9b0e509', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:01.125864 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a188d1-87a5-4b48-9dbf-05cf469f01e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:01.129979 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a188d1-87a5-4b48-9dbf-05cf469f01e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:01.134536 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2295c6-4650-4a27-b70f-980be8fe3379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:01.135743 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Volume 3eaddf40-8188-4b1b-980a-3be0b9b0e509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eaddf40-8188-4b1b-980a-3be0b9b0e509', 'volume_size': 1} Oct 22 21:18:01.136312 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] creating volume 'volume-3eaddf40-8188-4b1b-980a-3be0b9b0e509' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:18:01.137233 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:01.231918 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:18:01.232551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:18:01.237952 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2295c6-4650-4a27-b70f-980be8fe3379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eaddf40-8188-4b1b-980a-3be0b9b0e509', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:01.242560 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5ddb75-85c9-40f6-9cb4-178604c1ea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:01.254674 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Volume volume-3eaddf40-8188-4b1b-980a-3be0b9b0e509 (3eaddf40-8188-4b1b-980a-3be0b9b0e509): created successfully Oct 22 21:18:01.259843 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5ddb75-85c9-40f6-9cb4-178604c1ea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:01.265313 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Flow 'volume_create_manager' (06c71971-c860-47c2-9012-38b7c17eb0c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:01.276720 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5de6c551-1c54-4def-8f8c-6ff88989f7ea tempest-ServersNegativeTestJSON-766586991 None] Created volume successfully. Oct 22 21:18:02.470245 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:18:02.537494 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Flow 'volume_create_manager' (76381aff-aca5-40c3-b42d-0bbda2e259f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:02.553955 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120765e3-64f0-4b41-9f12-40f0c348808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:02.579303 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120765e3-64f0-4b41-9f12-40f0c348808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1070175631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3047e27f-1015-4d21-af62-7021d91faea6,host='ncdv-master-1@ceph#ceph',id=6ac3b97c-8136-4846-81de-480e52a20cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca9901d03124914bf282ea0cfa731f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:18:02Z,use_quota=True,user_id='2ce2e2785d3e4aa8b1870eb7044fa2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94b70ed7-b32b-4257-aef2-1a2d33b9ffff),volume_type_id=94b70ed7-b32b-4257-aef2-1a2d33b9ffff)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:02.588069 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2b957e-3751-4378-b8a8-aac5911af3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:02.597128 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2b957e-3751-4378-b8a8-aac5911af3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:02.603775 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6daad8-e98e-42dc-994e-8eb68dc6e4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:02.607684 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6daad8-e98e-42dc-994e-8eb68dc6e4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac3b97c-8136-4846-81de-480e52a20cb6', 'volume_name': 'volume-6ac3b97c-8136-4846-81de-480e52a20cb6', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:02.621629 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d67735d-dbd4-40eb-952c-2fb60c1c7829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:02.626342 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d67735d-dbd4-40eb-952c-2fb60c1c7829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:02.632185 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3088a22e-6df1-481c-9703-e22e0d5cfd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:02.634039 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Volume 6ac3b97c-8136-4846-81de-480e52a20cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac3b97c-8136-4846-81de-480e52a20cb6', 'volume_size': 1} Oct 22 21:18:02.634613 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] creating volume 'volume-6ac3b97c-8136-4846-81de-480e52a20cb6' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:18:02.635484 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:02.762654 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:18:02.763209 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:18:02.772714 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3088a22e-6df1-481c-9703-e22e0d5cfd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac3b97c-8136-4846-81de-480e52a20cb6', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:02.777621 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c828f6f-8a5b-40f9-8232-4c9540e21620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:02.797547 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Volume volume-6ac3b97c-8136-4846-81de-480e52a20cb6 (6ac3b97c-8136-4846-81de-480e52a20cb6): created successfully Oct 22 21:18:02.807039 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c828f6f-8a5b-40f9-8232-4c9540e21620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:02.818658 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Flow 'volume_create_manager' (76381aff-aca5-40c3-b42d-0bbda2e259f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:02.835391 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-3e1755c4-f007-4879-8b13-bd481c0b1348 tempest-GroupSnapshotsTest-1098440790 None] Created volume successfully. Oct 22 21:18:04.162333 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:18:04.211985 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Flow 'volume_create_manager' (ef0f6b1f-7aa1-4ca9-af0d-3a1e84e70b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:04.220131 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15456a9e-7881-458f-b92f-7947547fa306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.241109 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15456a9e-7881-458f-b92f-7947547fa306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-44825865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=201624cb-7374-478d-a393-3406988e013a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af724189a24022b3ef7651b7157a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:18:04Z,use_quota=True,user_id='6c8a9229e7da421b9e0e6f7df52f71e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.246535 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2537ea4f-51e9-483b-8ddd-8dd9e678029f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.252534 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2537ea4f-51e9-483b-8ddd-8dd9e678029f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.267760 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd59028-f7e2-4cf0-8169-ef68e692f6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.278103 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd59028-f7e2-4cf0-8169-ef68e692f6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '201624cb-7374-478d-a393-3406988e013a', 'volume_name': 'volume-201624cb-7374-478d-a393-3406988e013a', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.285949 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31cadf53-11f4-40c3-a1de-911ebb87b2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.290047 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31cadf53-11f4-40c3-a1de-911ebb87b2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.295640 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46787e0c-49cb-4ab9-8d1e-26f137b2f898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.298197 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Volume 201624cb-7374-478d-a393-3406988e013a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-201624cb-7374-478d-a393-3406988e013a', 'volume_size': 1} Oct 22 21:18:04.298712 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] creating volume 'volume-201624cb-7374-478d-a393-3406988e013a' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:18:04.299702 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:04.366846 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:18:04.395618 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Flow 'volume_create_manager' (4cbec249-832b-4c5f-ab59-56d26606cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:04.402703 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c70fa3-b3be-4fbe-bd82-866c1d8ec234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.411589 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:18:04.411966 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:18:04.417085 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46787e0c-49cb-4ab9-8d1e-26f137b2f898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201624cb-7374-478d-a393-3406988e013a', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.422165 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026b55c6-816c-4820-9164-6a9b49dee302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.438988 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Volume volume-201624cb-7374-478d-a393-3406988e013a (201624cb-7374-478d-a393-3406988e013a): created successfully Oct 22 21:18:04.442863 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026b55c6-816c-4820-9164-6a9b49dee302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.448142 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Flow 'volume_create_manager' (ef0f6b1f-7aa1-4ca9-af0d-3a1e84e70b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:04.456057 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c70fa3-b3be-4fbe-bd82-866c1d8ec234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1271963726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3047e27f-1015-4d21-af62-7021d91faea6,host='ncdv-master-1@ceph#ceph',id=6b7a6044-993a-4ed5-9fa9-0719f3962627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca9901d03124914bf282ea0cfa731f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:18:04Z,use_quota=True,user_id='2ce2e2785d3e4aa8b1870eb7044fa2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94b70ed7-b32b-4257-aef2-1a2d33b9ffff),volume_type_id=94b70ed7-b32b-4257-aef2-1a2d33b9ffff)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.461262 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3321af-47d4-49c0-9f71-9c099a712706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.465267 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3321af-47d4-49c0-9f71-9c099a712706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.470293 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a425be-525d-4d0e-9b07-d2e5d616c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.474406 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a425be-525d-4d0e-9b07-d2e5d616c90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b7a6044-993a-4ed5-9fa9-0719f3962627', 'volume_name': 'volume-6b7a6044-993a-4ed5-9fa9-0719f3962627', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.479439 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238712b3-bef5-4dcd-a2ea-f5485eb65948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.483149 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238712b3-bef5-4dcd-a2ea-f5485eb65948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.497150 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07894169-5352-4170-b90a-39291c48cece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.498385 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Volume 6b7a6044-993a-4ed5-9fa9-0719f3962627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b7a6044-993a-4ed5-9fa9-0719f3962627', 'volume_size': 1} Oct 22 21:18:04.498773 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] creating volume 'volume-6b7a6044-993a-4ed5-9fa9-0719f3962627' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:18:04.499500 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:04.542238 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-fd6ba975-3164-4046-b6f4-bc9a1230f806 tempest-ServersNegativeTestJSON-766586991 None] Created volume successfully. Oct 22 21:18:04.574144 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:18:04.574616 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:18:04.578386 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07894169-5352-4170-b90a-39291c48cece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7a6044-993a-4ed5-9fa9-0719f3962627', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.583267 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe2037a-eb80-4254-9d3d-d5f7dac53ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:04.595582 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Volume volume-6b7a6044-993a-4ed5-9fa9-0719f3962627 (6b7a6044-993a-4ed5-9fa9-0719f3962627): created successfully Oct 22 21:18:04.599584 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe2037a-eb80-4254-9d3d-d5f7dac53ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:04.605203 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Flow 'volume_create_manager' (4cbec249-832b-4c5f-ab59-56d26606cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:04.616951 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-bd13afe0-9827-4efe-9e44-156fd0fd95da tempest-GroupSnapshotsTest-1098440790 None] Created volume successfully. Oct 22 21:18:05.356463 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5cb28a10-5e31-49e0-8cf1-906f73756a73 tempest-GroupSnapshotsTest-1098440790 None] Update group completed successfully. Oct 22 21:18:06.526298 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e0b27c57-b087-48e0-b50f-58780f3197e5 tempest-GroupSnapshotsTest-1098440790 None] Update group completed successfully. Oct 22 21:18:07.651727 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-21b09eb3-e977-4835-9dbc-f7db34263082 tempest-GroupSnapshotsTest-1098440790 None] Update group completed successfully. Oct 22 21:18:08.836543 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2949408a-564e-47f7-a38a-5f3fe1c6634c tempest-GroupSnapshotsTest-1098440790 None] Update group completed successfully. Oct 22 21:18:10.383510 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7b02fa85-9383-4879-bfc1-122683e33c05 tempest-GroupSnapshotsTest-1098440790 None] GroupSnapshot d8f4bfed-ded0-42dd-a377-35343b3af757: creating. Oct 22 21:18:10.404925 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-7b02fa85-9383-4879-bfc1-122683e33c05 tempest-GroupSnapshotsTest-1098440790 None] Group snapshot d8f4bfed-ded0-42dd-a377-35343b3af757: creating. {{(pid=131630) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}} Oct 22 21:18:10.406893 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=77,cinder:INSERT=3,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:10.449622 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7b02fa85-9383-4879-bfc1-122683e33c05 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:10.767412 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7b02fa85-9383-4879-bfc1-122683e33c05 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:11.953475 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7b02fa85-9383-4879-bfc1-122683e33c05 tempest-GroupSnapshotsTest-1098440790 None] group_snapshot d8f4bfed-ded0-42dd-a377-35343b3af757: created successfully Oct 22 21:18:12.727932 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-44fd59ef-970f-41c2-9071-62fe30cf4ab1 tempest-GroupSnapshotsTest-1098440790 None] group_snapshot d8f4bfed-ded0-42dd-a377-35343b3af757: deleting Oct 22 21:18:12.803086 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44fd59ef-970f-41c2-9071-62fe30cf4ab1 tempest-GroupSnapshotsTest-1098440790 None] group_snapshot d8f4bfed-ded0-42dd-a377-35343b3af757: deleting {{(pid=131630) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}} Oct 22 21:18:12.841756 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-44fd59ef-970f-41c2-9071-62fe30cf4ab1 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:13.886530 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-44fd59ef-970f-41c2-9071-62fe30cf4ab1 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:14.944119 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-44fd59ef-970f-41c2-9071-62fe30cf4ab1 tempest-GroupSnapshotsTest-1098440790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1660445919 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1660445919, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:18:14.945611 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-44fd59ef-970f-41c2-9071-62fe30cf4ab1 tempest-GroupSnapshotsTest-1098440790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1660445919 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1660445919, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:18:14.963688 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-44fd59ef-970f-41c2-9071-62fe30cf4ab1 tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['84f6d922-fe57-4505-a2cb-fb6074a1d73d', 'ca49f2e8-d394-403f-acd9-2c6a9a1fb91c', 'e1e4471f-25f8-470e-afa9-00d13c5d360f', 'ecc76586-6854-4816-9d9c-e9a83f3ef449'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:18:14.983195 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:INSERT=3,cinder:UPDATE=26,cinder:SELECT=69,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:15.119540 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-44fd59ef-970f-41c2-9071-62fe30cf4ab1 tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['a60e42d6-6a84-43fe-b0cd-4968c3b563d6', 'ad97ee9b-651c-434b-b3f5-39cff25ff18f', '05494564-87d6-497a-9c86-84f8a99d5f9c', '3980712a-8e58-4338-bd80-e1222e1cb6b0'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:18:15.183751 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-44fd59ef-970f-41c2-9071-62fe30cf4ab1 tempest-GroupSnapshotsTest-1098440790 None] group_snapshot d8f4bfed-ded0-42dd-a377-35343b3af757: deleted successfully Oct 22 21:18:15.493801 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:15.551981 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:18:15.552408 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] Volume volume-6ac3b97c-8136-4846-81de-480e52a20cb6 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:18:15.558540 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] deleting rbd volume volume-6ac3b97c-8136-4846-81de-480e52a20cb6 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:18:15.722103 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:15.766020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:18:15.766463 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] Volume volume-6b7a6044-993a-4ed5-9fa9-0719f3962627 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:18:15.771527 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] deleting rbd volume volume-6b7a6044-993a-4ed5-9fa9-0719f3962627 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:18:15.990620 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['4872056d-23e4-4ec7-afb5-b862f94d1f00'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:18:16.009542 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1660445919 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1660445919, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:18:16.024978 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['fe501b90-d09c-4904-93f5-b5d8e3667533', '27c81162-1d2e-4867-97ac-72feffbd2c50', '3e51de2c-6e51-413a-ab51-8ed434e7874a', '5f89ffd1-97f6-4fda-bccc-88f3a814c5ca'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:18:16.101111 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['42612e27-e82f-41e3-8ccb-8e1ed0809f1d', 'a5a65cc3-cca6-4929-9a37-c9153d27599a', '9b39e404-48ed-4c79-a4fd-72119adaad39', '4a46f776-98b4-47ae-af0d-f76120f3f016'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:18:16.125019 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=62,cinder:UPDATE=27,cinder:INSERT=11 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:16.196672 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:16.239512 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:16.284426 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:18:16.293038 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a5d0dbdb-910f-4c4b-89db-98d2a6ef88d7 tempest-GroupSnapshotsTest-1098440790 None] Delete group completed successfully. Oct 22 21:18:16.979670 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b101257d-6bf2-4dab-8fc8-c79e4f877e63 tempest-GroupSnapshotsTest-1098440790 None] Group tempest-GroupSnapshotsTest-Group-1072316739: creating Oct 22 21:18:17.000925 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b101257d-6bf2-4dab-8fc8-c79e4f877e63 tempest-GroupSnapshotsTest-1098440790 None] Group tempest-GroupSnapshotsTest-Group-1072316739: created successfully Oct 22 21:18:17.011844 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b101257d-6bf2-4dab-8fc8-c79e4f877e63 tempest-GroupSnapshotsTest-1098440790 None] Create group completed successfully. Oct 22 21:18:18.506094 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:18:18.529202 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Flow 'volume_create_manager' (4903b792-3d95-4652-98e0-1e1491b83de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:18.537342 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a595d467-e234-4ea0-8d7b-57ed34c7bd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:18.564530 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a595d467-e234-4ea0-8d7b-57ed34c7bd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-513545361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b846cfaa-465e-490c-8bcb-def4bcc9777c,host='ncdv-master-1@ceph#ceph',id=ae73b9b9-e73f-4bbf-82f2-28f6f2c521ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca9901d03124914bf282ea0cfa731f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:18:18Z,use_quota=True,user_id='2ce2e2785d3e4aa8b1870eb7044fa2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ad232ea-bca8-4631-a61a-b04e7fc80dff),volume_type_id=1ad232ea-bca8-4631-a61a-b04e7fc80dff)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:18.578161 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea8c228-65fe-4d06-be85-80483965dcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:18.582684 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea8c228-65fe-4d06-be85-80483965dcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:18.596883 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e0e460-b4c2-4163-a244-ff052fe40f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:18.605250 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e0e460-b4c2-4163-a244-ff052fe40f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae73b9b9-e73f-4bbf-82f2-28f6f2c521ee', 'volume_name': 'volume-ae73b9b9-e73f-4bbf-82f2-28f6f2c521ee', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:18.612097 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4628597c-9c05-44b5-9baf-194d60f2a5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:18.617408 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4628597c-9c05-44b5-9baf-194d60f2a5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:18.623675 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10646fdf-a36f-403e-9533-9189032d4c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:18.625246 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Volume ae73b9b9-e73f-4bbf-82f2-28f6f2c521ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae73b9b9-e73f-4bbf-82f2-28f6f2c521ee', 'volume_size': 1} Oct 22 21:18:18.627211 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] creating volume 'volume-ae73b9b9-e73f-4bbf-82f2-28f6f2c521ee' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:18:18.628444 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:18.719625 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:18:18.720031 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:18:18.725632 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10646fdf-a36f-403e-9533-9189032d4c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae73b9b9-e73f-4bbf-82f2-28f6f2c521ee', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:18.730818 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ef3d94-ae57-4a5b-a503-d2e7206ba71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:18.744670 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Volume volume-ae73b9b9-e73f-4bbf-82f2-28f6f2c521ee (ae73b9b9-e73f-4bbf-82f2-28f6f2c521ee): created successfully Oct 22 21:18:18.748857 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ef3d94-ae57-4a5b-a503-d2e7206ba71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:18.755984 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Flow 'volume_create_manager' (4903b792-3d95-4652-98e0-1e1491b83de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:18.768421 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f327591c-8600-4506-b19d-ff76d40a90f6 tempest-GroupSnapshotsTest-1098440790 None] Created volume successfully. Oct 22 21:18:19.816707 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8d1c46da-9e41-4f8a-9dfa-92f97c0ff0b3 tempest-GroupSnapshotsTest-1098440790 None] GroupSnapshot 93145233-12d1-4f4f-a2d9-8aeaf2471017: creating. Oct 22 21:18:19.870759 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-8d1c46da-9e41-4f8a-9dfa-92f97c0ff0b3 tempest-GroupSnapshotsTest-1098440790 None] Group snapshot 93145233-12d1-4f4f-a2d9-8aeaf2471017: creating. {{(pid=131630) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}} Oct 22 21:18:19.897687 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8d1c46da-9e41-4f8a-9dfa-92f97c0ff0b3 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:20.578842 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8d1c46da-9e41-4f8a-9dfa-92f97c0ff0b3 tempest-GroupSnapshotsTest-1098440790 None] group_snapshot 93145233-12d1-4f4f-a2d9-8aeaf2471017: created successfully Oct 22 21:18:21.058813 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a68760ce-d360-4516-9824-0ca97598913e tempest-GroupSnapshotsTest-1098440790 None] group_snapshot 93145233-12d1-4f4f-a2d9-8aeaf2471017: deleting Oct 22 21:18:21.073132 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=62,cinder:INSERT=5,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:21.079771 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-a68760ce-d360-4516-9824-0ca97598913e tempest-GroupSnapshotsTest-1098440790 None] group_snapshot 93145233-12d1-4f4f-a2d9-8aeaf2471017: deleting {{(pid=131630) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}} Oct 22 21:18:21.100575 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a68760ce-d360-4516-9824-0ca97598913e tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:21.586681 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-a68760ce-d360-4516-9824-0ca97598913e tempest-GroupSnapshotsTest-1098440790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1109448062 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1109448062, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:18:21.587541 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-a68760ce-d360-4516-9824-0ca97598913e tempest-GroupSnapshotsTest-1098440790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1109448062 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1109448062, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:18:21.608065 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a68760ce-d360-4516-9824-0ca97598913e tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['db479019-41d4-47c3-ad63-32063fafad0d', 'f54c39f7-154a-49bd-b256-51712e9e2930', 'c3dfd393-eb72-4ade-93ad-1b12d3051c37', 'ebcd82fb-5e4a-4ca2-97b8-28aa12e7ea10'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:18:21.671705 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a68760ce-d360-4516-9824-0ca97598913e tempest-GroupSnapshotsTest-1098440790 None] group_snapshot 93145233-12d1-4f4f-a2d9-8aeaf2471017: deleted successfully Oct 22 21:18:22.743020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-616ee2ca-08a1-4e07-8465-89df738b0a54 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:22.830060 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-616ee2ca-08a1-4e07-8465-89df738b0a54 tempest-GroupSnapshotsTest-1098440790 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:18:22.830060 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-616ee2ca-08a1-4e07-8465-89df738b0a54 tempest-GroupSnapshotsTest-1098440790 None] Volume volume-ae73b9b9-e73f-4bbf-82f2-28f6f2c521ee is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:18:22.830060 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-616ee2ca-08a1-4e07-8465-89df738b0a54 tempest-GroupSnapshotsTest-1098440790 None] deleting rbd volume volume-ae73b9b9-e73f-4bbf-82f2-28f6f2c521ee {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:18:23.141034 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-616ee2ca-08a1-4e07-8465-89df738b0a54 tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['1fc47512-b2d0-4cef-a291-34b3015696b7'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:18:23.161368 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-616ee2ca-08a1-4e07-8465-89df738b0a54 tempest-GroupSnapshotsTest-1098440790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1109448062 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1109448062, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:18:23.192710 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-616ee2ca-08a1-4e07-8465-89df738b0a54 tempest-GroupSnapshotsTest-1098440790 None] Created reservations ['6b049e35-0308-4c33-ac23-736712c7b6b3', '7d0f77ae-18e3-4adb-8758-55827c50be5d', '8da107c3-ecc1-4901-8847-c4e0ac49d6b5', '44a9ad3b-83e0-47ce-b0c1-ef8312c35ae5'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:18:23.303860 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-616ee2ca-08a1-4e07-8465-89df738b0a54 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:23.363505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-616ee2ca-08a1-4e07-8465-89df738b0a54 tempest-GroupSnapshotsTest-1098440790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:23.438118 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-616ee2ca-08a1-4e07-8465-89df738b0a54 tempest-GroupSnapshotsTest-1098440790 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:18:23.444558 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-616ee2ca-08a1-4e07-8465-89df738b0a54 tempest-GroupSnapshotsTest-1098440790 None] Delete group completed successfully. Oct 22 21:18:30.512359 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:18:30.513018 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:30.563684 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:30.654757 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:18:35.984307 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4ccddfec-4779-4163-ae00-4de2b4c01a4d tempest-GroupsV320Test-617906243 None] Group tempest-GroupsV320Test-Group-179475002: creating Oct 22 21:18:36.003572 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4ccddfec-4779-4163-ae00-4de2b4c01a4d tempest-GroupsV320Test-617906243 None] Group tempest-GroupsV320Test-Group-179475002: created successfully Oct 22 21:18:36.012692 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4ccddfec-4779-4163-ae00-4de2b4c01a4d tempest-GroupsV320Test-617906243 None] Create group completed successfully. Oct 22 21:18:37.495112 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=32,cinder:SELECT=64,cinder:INSERT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:37.510126 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-3ad71c9c-b4fa-4978-b74c-087a6d35710d tempest-GroupsV320Test-617906243 None] Created reservations ['1e3281a4-45d5-4fff-962c-9018e6264d3f'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:18:37.543853 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ad71c9c-b4fa-4978-b74c-087a6d35710d tempest-GroupsV320Test-617906243 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:37.570929 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ad71c9c-b4fa-4978-b74c-087a6d35710d tempest-GroupsV320Test-617906243 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:37.599593 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-3ad71c9c-b4fa-4978-b74c-087a6d35710d tempest-GroupsV320Test-617906243 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:18:37.603936 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-3ad71c9c-b4fa-4978-b74c-087a6d35710d tempest-GroupsV320Test-617906243 None] Delete group completed successfully. Oct 22 21:18:44.926742 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:18:44.946767 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Flow 'volume_create_manager' (97b7d523-46ff-41a9-a01d-c4fdd32a24ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:44.954136 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c7933a-a497-4fa8-8727-d89d5d8b71dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:44.983546 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c7933a-a497-4fa8-8727-d89d5d8b71dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1770741016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f860c859-2007-4e00-a13a-0c7f482faf2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a842ea22ed44edc87c72ebe78997ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:18:45Z,use_quota=True,user_id='27830a8c64704ddb98917c66bda33b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:44.999997 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb94c6e5-8333-49b6-be49-05c3cee6029a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:45.004896 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb94c6e5-8333-49b6-be49-05c3cee6029a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:45.010320 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2987ee49-beee-458b-a20f-308e40f6ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:45.014648 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2987ee49-beee-458b-a20f-308e40f6ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f860c859-2007-4e00-a13a-0c7f482faf2a', 'volume_name': 'volume-f860c859-2007-4e00-a13a-0c7f482faf2a', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:45.024137 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af4d9ec-84a1-4861-bde7-242922b9df03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:45.045775 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af4d9ec-84a1-4861-bde7-242922b9df03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:45.053443 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db9cc801-3eef-42d2-a3b1-286bf0bca100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:45.056569 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Volume f860c859-2007-4e00-a13a-0c7f482faf2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f860c859-2007-4e00-a13a-0c7f482faf2a', 'volume_size': 1} Oct 22 21:18:45.058621 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] creating volume 'volume-f860c859-2007-4e00-a13a-0c7f482faf2a' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:18:45.061739 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:45.155544 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:18:45.156232 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:18:45.170913 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db9cc801-3eef-42d2-a3b1-286bf0bca100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f860c859-2007-4e00-a13a-0c7f482faf2a', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:45.185205 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59cd7e2-fc20-40f4-8af4-7f2b3d66d02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:45.205338 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Volume volume-f860c859-2007-4e00-a13a-0c7f482faf2a (f860c859-2007-4e00-a13a-0c7f482faf2a): created successfully Oct 22 21:18:45.210963 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59cd7e2-fc20-40f4-8af4-7f2b3d66d02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:45.220062 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Flow 'volume_create_manager' (97b7d523-46ff-41a9-a01d-c4fdd32a24ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:45.241539 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-36ec71db-374d-44bd-bd42-33ac6b66ec96 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Created volume successfully. Oct 22 21:18:46.078721 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] Acquiring lock "cinder-f860c859-2007-4e00-a13a-0c7f482faf2a-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:18:46.091680 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] Lock "cinder-f860c859-2007-4e00-a13a-0c7f482faf2a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:18:46.140287 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:46.221244 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:18:46.222390 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] Volume volume-f860c859-2007-4e00-a13a-0c7f482faf2a is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:18:46.240302 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] deleting rbd volume volume-f860c859-2007-4e00-a13a-0c7f482faf2a {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:18:46.592068 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] Created reservations ['d5a8b675-a78f-45dc-8cd8-75b954e6cf18', 'a8a0c8f0-475f-4d2f-8076-091def38de68', '76fd8e19-9557-4941-9dbc-4e46c5ae4d28', '92e21b4d-1cec-4e94-9a3c-658e3d6e47e7'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:18:46.636091 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=64,cinder:INSERT=8,cinder:UPDATE=28 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:18:46.649018 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:46.700665 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:46.740453 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:18:46.746341 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] Deleted volume successfully. Oct 22 21:18:46.765943 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4c363818-dc6b-4797-b8cf-62104ce248cb tempest-VolumeQuotasAdminTestJSON-2142173218 None] Lock "cinder-f860c859-2007-4e00-a13a-0c7f482faf2a-delete_volume" released by "delete_volume" :: held 0.674s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:18:47.831067 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:18:47.860738 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Flow 'volume_create_manager' (93a24cd8-6ccc-4b4f-a30d-00af7fb086cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:47.867889 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71512348-c70c-4121-896a-544c9ae5ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:47.887252 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71512348-c70c-4121-896a-544c9ae5ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-360147526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4b3dafaf-c89c-467d-a93a-0a6db9659829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a842ea22ed44edc87c72ebe78997ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:18:48Z,use_quota=True,user_id='27830a8c64704ddb98917c66bda33b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:47.893551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157d347d-bb8d-4939-9eb1-71c61809a53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:47.897945 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157d347d-bb8d-4939-9eb1-71c61809a53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:47.904185 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1997d39f-7bdd-4b92-821e-b2a347a741cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:47.908911 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1997d39f-7bdd-4b92-821e-b2a347a741cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3dafaf-c89c-467d-a93a-0a6db9659829', 'volume_name': 'volume-4b3dafaf-c89c-467d-a93a-0a6db9659829', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:47.914880 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2eb164-3cdb-4fbc-bbf4-f63642a6ef55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:47.920226 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2eb164-3cdb-4fbc-bbf4-f63642a6ef55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:47.926786 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460df34f-dfdc-4d7c-8823-5c39cce8cc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:47.928296 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Volume 4b3dafaf-c89c-467d-a93a-0a6db9659829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3dafaf-c89c-467d-a93a-0a6db9659829', 'volume_size': 1} Oct 22 21:18:47.928924 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] creating volume 'volume-4b3dafaf-c89c-467d-a93a-0a6db9659829' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:18:47.930171 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:48.027273 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:18:48.028022 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:18:48.034414 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460df34f-dfdc-4d7c-8823-5c39cce8cc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3dafaf-c89c-467d-a93a-0a6db9659829', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:48.039932 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3701497-58e9-4764-b29b-3283cd36bd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:18:48.066882 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Volume volume-4b3dafaf-c89c-467d-a93a-0a6db9659829 (4b3dafaf-c89c-467d-a93a-0a6db9659829): created successfully Oct 22 21:18:48.070790 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3701497-58e9-4764-b29b-3283cd36bd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:18:48.081268 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Flow 'volume_create_manager' (93a24cd8-6ccc-4b4f-a30d-00af7fb086cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:18:48.096044 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6a8636c2-1c50-4bb3-b155-7e79790ccbb8 tempest-VolumeQuotasAdminTestJSON-2142173218 None] Created volume successfully. Oct 22 21:18:49.672958 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7013e3bc-5113-4379-b91e-bd4cab3a82d4 tempest-VolumeQuotasAdminTestJSON-561390006 None] Transfer volume completed successfully. Oct 22 21:18:50.401744 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] Acquiring lock "cinder-4b3dafaf-c89c-467d-a93a-0a6db9659829-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:18:50.417376 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] Lock "cinder-4b3dafaf-c89c-467d-a93a-0a6db9659829-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:18:50.459044 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:50.541123 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:18:50.541542 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] Volume volume-4b3dafaf-c89c-467d-a93a-0a6db9659829 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:18:50.550174 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] deleting rbd volume volume-4b3dafaf-c89c-467d-a93a-0a6db9659829 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:18:51.179788 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] Created reservations ['24fc9a9b-d283-4ebe-b54b-610112196065', 'd86cb904-31bc-4114-a55b-b8b6928f7716', '9f94f5ec-74ee-4b33-9922-dc002529236d', '6b3baa34-4149-443b-a585-bd5287d5fd91'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:18:51.287841 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:51.369233 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:18:51.453005 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:18:51.461932 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] Deleted volume successfully. Oct 22 21:18:51.485311 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2929d909-4ff4-4f4f-96ee-ecdad491cd52 tempest-VolumeQuotasAdminTestJSON-628630165 None] Lock "cinder-4b3dafaf-c89c-467d-a93a-0a6db9659829-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:18:59.928513 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:18:59.990586 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Flow 'volume_create_manager' (c2d9aa02-23c4-4440-bcdf-ab9290a1f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:19:00.004324 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b69356a-7ea4-460c-8806-6e56fe965514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:00.033785 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b69356a-7ea4-460c-8806-6e56fe965514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1766718019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=601f6db4-d9a9-4be6-8cbe-f5133df34263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d5517b0f8148ddb0c10e8c885ee0ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:19:00Z,use_quota=True,user_id='bd0a47216e044a019e4846b4a78b6839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed83f0be-b7ed-444f-a3ec-d82a26f7c6ea),volume_type_id=ed83f0be-b7ed-444f-a3ec-d82a26f7c6ea)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:00.046486 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee88bc4-f7ce-475a-b97a-ddee7f0e3da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:00.050926 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee88bc4-f7ce-475a-b97a-ddee7f0e3da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:00.066611 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618f7b90-9d5e-4aaa-929c-df31c95f2b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:00.073446 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618f7b90-9d5e-4aaa-929c-df31c95f2b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601f6db4-d9a9-4be6-8cbe-f5133df34263', 'volume_name': 'volume-601f6db4-d9a9-4be6-8cbe-f5133df34263', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:00.079034 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239fe8e8-2d98-408e-9bda-de0fe5b6f910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:00.093652 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239fe8e8-2d98-408e-9bda-de0fe5b6f910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:00.102809 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78bf00d-bb0d-43b1-a44a-919296e065e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:00.106366 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Volume 601f6db4-d9a9-4be6-8cbe-f5133df34263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601f6db4-d9a9-4be6-8cbe-f5133df34263', 'volume_size': 1} Oct 22 21:19:00.107065 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] creating volume 'volume-601f6db4-d9a9-4be6-8cbe-f5133df34263' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:19:00.108364 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:00.233425 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] extra_specs: {} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:19:00.234301 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] extra_specs: {} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:19:00.240853 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78bf00d-bb0d-43b1-a44a-919296e065e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601f6db4-d9a9-4be6-8cbe-f5133df34263', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:00.245736 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2399863f-8cb7-4a44-9fd1-fc2fddf3b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:00.262909 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Volume volume-601f6db4-d9a9-4be6-8cbe-f5133df34263 (601f6db4-d9a9-4be6-8cbe-f5133df34263): created successfully Oct 22 21:19:00.267424 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2399863f-8cb7-4a44-9fd1-fc2fddf3b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:00.275991 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Flow 'volume_create_manager' (c2d9aa02-23c4-4440-bcdf-ab9290a1f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:19:00.294711 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-1d6008e6-97ba-455b-bfc4-b22a7c66a7e5 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Created volume successfully. Oct 22 21:19:01.433644 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-dd02f981-9099-44db-bb61-a7cb97a79cd9 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:01.477133 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-dd02f981-9099-44db-bb61-a7cb97a79cd9 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:01.522459 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-dd02f981-9099-44db-bb61-a7cb97a79cd9 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:19:01.526797 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-dd02f981-9099-44db-bb61-a7cb97a79cd9 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Retype volume completed successfully. Oct 22 21:19:02.733412 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Acquiring lock "cinder-601f6db4-d9a9-4be6-8cbe-f5133df34263-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:19:02.763883 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Lock "cinder-601f6db4-d9a9-4be6-8cbe-f5133df34263-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:19:02.821568 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:02.874263 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:19:02.874708 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Volume volume-601f6db4-d9a9-4be6-8cbe-f5133df34263 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:19:02.883689 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] deleting rbd volume volume-601f6db4-d9a9-4be6-8cbe-f5133df34263 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:19:03.179991 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=58,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:03.196898 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:19:03.198174 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:19:03.222241 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Created reservations ['dcff737e-73aa-4e49-82a0-f1384ef21730', '3f367685-8c4e-4bb7-be1d-44e8616c7873', '29162875-c6b9-4ed2-99a7-1cf18a7944e6', '9fbfc12a-43d2-45a7-b3eb-2c4300308251'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:19:03.297154 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:03.381572 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:03.470995 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:19:03.480057 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Deleted volume successfully. Oct 22 21:19:03.501615 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a85ce295-15d0-4d0c-958b-a11502091f48 tempest-VolumeRetypeWithoutMigrationTest-634434263 None] Lock "cinder-601f6db4-d9a9-4be6-8cbe-f5133df34263-delete_volume" released by "delete_volume" :: held 0.738s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:19:10.272393 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:19:10.341473 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Flow 'volume_create_manager' (af4c3fdb-b161-4ad3-88c8-1d8265dd0a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:19:10.357141 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60382eae-0a3c-443a-984e-16fe8d460fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:10.394841 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60382eae-0a3c-443a-984e-16fe8d460fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1591725722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b14fda93-7fbd-4520-97ae-f8813647b9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e45a8d0bd54e3987426351322a9e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:19:10Z,use_quota=True,user_id='49977b6c27df4a289e136e5441e17f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03af1368-66b5-4460-9b8c-feeaec2c96c6),volume_type_id=03af1368-66b5-4460-9b8c-feeaec2c96c6)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:10.406007 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f931e82-963a-4df9-89da-c6371081821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:10.418529 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f931e82-963a-4df9-89da-c6371081821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:10.428735 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4cdefc-42c9-4575-bae7-19af15fd8396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:10.442129 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4cdefc-42c9-4575-bae7-19af15fd8396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14fda93-7fbd-4520-97ae-f8813647b9df', 'volume_name': 'volume-b14fda93-7fbd-4520-97ae-f8813647b9df', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:10.449463 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c57524b-c3f9-4839-a28f-121d0091f950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:10.468835 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c57524b-c3f9-4839-a28f-121d0091f950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:10.488137 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b5b939-f88c-4ac3-be79-61ada906f362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:10.489751 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Volume b14fda93-7fbd-4520-97ae-f8813647b9df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14fda93-7fbd-4520-97ae-f8813647b9df', 'volume_size': 1} Oct 22 21:19:10.490362 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] creating volume 'volume-b14fda93-7fbd-4520-97ae-f8813647b9df' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:19:10.491385 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:10.659607 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:19:10.660190 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:19:10.663912 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b5b939-f88c-4ac3-be79-61ada906f362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14fda93-7fbd-4520-97ae-f8813647b9df', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:10.677541 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bcf167-f38e-40a6-83de-ba61c662481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:10.707471 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Volume volume-b14fda93-7fbd-4520-97ae-f8813647b9df (b14fda93-7fbd-4520-97ae-f8813647b9df): created successfully Oct 22 21:19:10.711568 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bcf167-f38e-40a6-83de-ba61c662481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:10.728518 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Flow 'volume_create_manager' (af4c3fdb-b161-4ad3-88c8-1d8265dd0a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:19:10.749719 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d2107be9-4285-46f8-b586-78adb9d13b0c tempest-VolumeTypesTest-547367284 None] Created volume successfully. Oct 22 21:19:11.783671 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=66,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:11.810321 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-53c62e2d-ef1f-4da4-9353-290f8dd94a70 tempest-VolumeTypesTest-547367284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:11.870269 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-53c62e2d-ef1f-4da4-9353-290f8dd94a70 tempest-VolumeTypesTest-547367284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:11.952712 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-53c62e2d-ef1f-4da4-9353-290f8dd94a70 tempest-VolumeTypesTest-547367284 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:19:11.977627 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-53c62e2d-ef1f-4da4-9353-290f8dd94a70 tempest-VolumeTypesTest-547367284 None] Retype volume completed successfully. Oct 22 21:19:15.076938 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] Acquiring lock "cinder-b14fda93-7fbd-4520-97ae-f8813647b9df-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:19:15.103678 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] Lock "cinder-b14fda93-7fbd-4520-97ae-f8813647b9df-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:19:15.186742 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:15.274958 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:19:15.275426 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] Volume volume-b14fda93-7fbd-4520-97ae-f8813647b9df is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:19:15.284393 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] deleting rbd volume volume-b14fda93-7fbd-4520-97ae-f8813647b9df {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:19:15.666892 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1212381462 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1212381462, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:19:15.671928 ncdv-master-1 cinder-volume[131630]: WARNING cinder.quota [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1212381462 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1212381462, it is now deprecated. Please use the default quota class for default quota. Oct 22 21:19:15.705074 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] Created reservations ['9934cb64-0d17-47f0-837b-bba6fbea46dd', '4e096b37-abb9-44cf-8551-7ede76f54ac1', 'f49939d5-73fa-4912-926a-253ad4a25de5', '359b62b3-3086-4369-b7d4-ad55095403c2'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:19:15.784161 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:15.854865 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:15.917691 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:19:15.922349 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] Deleted volume successfully. Oct 22 21:19:15.947916 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-025abaef-7873-451d-94fa-822cb529111d tempest-VolumeTypesTest-547367284 None] Lock "cinder-b14fda93-7fbd-4520-97ae-f8813647b9df-delete_volume" released by "delete_volume" :: held 0.844s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:19:25.212021 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:19:25.254788 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Flow 'volume_create_manager' (d1e21bf1-395a-4651-8238-842454402234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:19:25.273677 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc35bad-406b-462f-8160-8daed0a78921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:25.306317 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc35bad-406b-462f-8160-8daed0a78921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1188664300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=811cc581-d18c-42f2-9ed3-998fe96ff7db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e8ea67336a41ac85bb0baf5a543bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:19:25Z,use_quota=True,user_id='493704ce3fee45019085b9d54a02ec6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:25.320013 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f613af-824d-4500-be10-1d951f8432cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:25.329515 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f613af-824d-4500-be10-1d951f8432cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:25.339949 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1de980-6122-4dff-93a3-76db084cd83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:25.352101 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1de980-6122-4dff-93a3-76db084cd83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '811cc581-d18c-42f2-9ed3-998fe96ff7db', 'volume_name': 'volume-811cc581-d18c-42f2-9ed3-998fe96ff7db', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:25.357682 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205dd8d1-b551-4155-afd8-eb3f00058190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:25.364284 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205dd8d1-b551-4155-afd8-eb3f00058190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:25.369113 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab6af8a-0ff5-42d0-aec6-714340e39bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:25.370325 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Volume 811cc581-d18c-42f2-9ed3-998fe96ff7db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-811cc581-d18c-42f2-9ed3-998fe96ff7db', 'volume_size': 1} Oct 22 21:19:25.370900 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] creating volume 'volume-811cc581-d18c-42f2-9ed3-998fe96ff7db' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:19:25.371874 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:25.485779 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:19:25.486162 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:19:25.489899 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab6af8a-0ff5-42d0-aec6-714340e39bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-811cc581-d18c-42f2-9ed3-998fe96ff7db', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:25.494668 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2448568-d58d-4f32-b9b5-8430a606955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:25.510826 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Volume volume-811cc581-d18c-42f2-9ed3-998fe96ff7db (811cc581-d18c-42f2-9ed3-998fe96ff7db): created successfully Oct 22 21:19:25.514881 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2448568-d58d-4f32-b9b5-8430a606955f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:25.520777 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Flow 'volume_create_manager' (d1e21bf1-395a-4651-8238-842454402234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:19:25.532614 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-886c9c14-a602-49ef-8715-1a6ab4a84d34 tempest-VolumesDeleteCascade-1582630966 None] Created volume successfully. Oct 22 21:19:26.555397 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-45b7b070-c40d-459f-bbf0-9daa19423e74 tempest-VolumesDeleteCascade-1582630966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:26.924385 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-45b7b070-c40d-459f-bbf0-9daa19423e74 tempest-VolumesDeleteCascade-1582630966 None] Create snapshot completed successfully Oct 22 21:19:27.807601 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-10c3cec5-ef47-46a5-9cb1-8562145874a9 tempest-VolumesDeleteCascade-1582630966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:28.943529 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-10c3cec5-ef47-46a5-9cb1-8562145874a9 tempest-VolumesDeleteCascade-1582630966 None] Create snapshot completed successfully Oct 22 21:19:30.009287 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Acquiring lock "cinder-811cc581-d18c-42f2-9ed3-998fe96ff7db-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:19:30.027460 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Lock "cinder-811cc581-d18c-42f2-9ed3-998fe96ff7db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:19:30.101485 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Performing cascade delete. {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}} Oct 22 21:19:30.116635 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Acquiring lock "cinder-16e1318a-c8e4-43d1-a1cc-270e1f4ede62-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:19:30.127623 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Lock "cinder-16e1318a-c8e4-43d1-a1cc-270e1f4ede62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:19:30.151107 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:30.512101 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:19:30.513243 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:30.579549 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:30.659845 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:19:31.066567 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Created reservations ['5b63501b-636b-4d24-982d-5ab92760113f', '7280de7c-927f-4a98-bb56-6ddf152af719', '36fea9a3-8239-40b0-aaaa-e83cc125c6a5', '41eb88d1-7ebd-4286-8e1d-f1630cfa4149'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:19:31.071142 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=30,cinder:SELECT=63,cinder:INSERT=5,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:31.124571 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Delete snapshot completed successfully. Oct 22 21:19:31.132998 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Lock "cinder-16e1318a-c8e4-43d1-a1cc-270e1f4ede62-delete_snapshot" released by "delete_snapshot" :: held 1.005s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:19:31.134836 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Acquiring lock "cinder-7794f52c-c251-4d53-9710-f45f8031c364-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:19:31.154031 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Lock "cinder-7794f52c-c251-4d53-9710-f45f8031c364-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:19:31.175939 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:32.104178 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Created reservations ['f289520c-1916-4384-96ce-07f81ab4114c', 'c78237e7-e6ba-4256-9c1b-a12d0102a7bc', 'f9325c23-5cc7-4c6c-8302-43d909fe68dd', '805e039c-993b-4f02-93f8-08283cbfc488'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:19:32.158962 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Delete snapshot completed successfully. Oct 22 21:19:32.165018 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Lock "cinder-7794f52c-c251-4d53-9710-f45f8031c364-delete_snapshot" released by "delete_snapshot" :: held 1.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:19:32.165825 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Snapshots deleted, issuing volume delete {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}} Oct 22 21:19:32.166986 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:32.225409 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:19:32.225946 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Volume volume-811cc581-d18c-42f2-9ed3-998fe96ff7db is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:19:32.238188 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] deleting rbd volume volume-811cc581-d18c-42f2-9ed3-998fe96ff7db {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:19:32.547378 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Created reservations ['874fb6ad-ff3c-45e3-bfe6-673262121fc1', '844f3a60-3113-4ce6-a12e-cef20d837b23', '1d942f35-96ef-41a5-9810-e9c3adf2c70d', '948a4063-0375-46af-a94e-4569ea85f1c9'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:19:32.557471 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=59,cinder:INSERT=8,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:32.642626 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:32.724505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:32.806034 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:19:32.812059 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Deleted volume successfully. Oct 22 21:19:32.834273 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-25a99e23-64d0-4b62-ac0f-f0b0acf9c1e6 tempest-VolumesDeleteCascade-1582630966 None] Lock "cinder-811cc581-d18c-42f2-9ed3-998fe96ff7db-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:19:38.503835 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:19:38.556858 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Flow 'volume_create_manager' (e915de7a-ba44-4aba-81b8-83475c000dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:19:38.568086 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33dfe122-a79d-488f-98ed-2d0c02b96aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:38.597353 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33dfe122-a79d-488f-98ed-2d0c02b96aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-39544307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=82794278-847a-4708-a6e5-c881dc3ec19e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb594dfc7d54c26b2badde74ee74d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:19:38Z,use_quota=True,user_id='712b1eb4d5f542219f248896a5b85be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:38.609364 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8ecadc-fbf1-4112-8c37-a3901dca3722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:38.613814 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8ecadc-fbf1-4112-8c37-a3901dca3722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:38.619673 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7aa3be-d968-49fe-aaf4-56fd8b7d9bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:38.626794 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7aa3be-d968-49fe-aaf4-56fd8b7d9bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82794278-847a-4708-a6e5-c881dc3ec19e', 'volume_name': 'volume-82794278-847a-4708-a6e5-c881dc3ec19e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:38.631901 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2023a5a-d01a-4d57-880b-b7819b47b5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:38.648186 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2023a5a-d01a-4d57-880b-b7819b47b5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:38.663238 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afe58bc-13e8-4169-9cad-ec2e4e9463c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:38.664410 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Volume 82794278-847a-4708-a6e5-c881dc3ec19e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82794278-847a-4708-a6e5-c881dc3ec19e', 'volume_size': 1} Oct 22 21:19:38.664812 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] creating volume 'volume-82794278-847a-4708-a6e5-c881dc3ec19e' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:19:38.665744 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:38.799528 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:19:38.800174 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:19:38.803827 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afe58bc-13e8-4169-9cad-ec2e4e9463c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82794278-847a-4708-a6e5-c881dc3ec19e', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:38.818053 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a214f37-cb1b-429d-b699-32fb802add08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:19:38.841790 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Volume volume-82794278-847a-4708-a6e5-c881dc3ec19e (82794278-847a-4708-a6e5-c881dc3ec19e): created successfully Oct 22 21:19:38.845838 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a214f37-cb1b-429d-b699-32fb802add08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:19:38.851622 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Flow 'volume_create_manager' (e915de7a-ba44-4aba-81b8-83475c000dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:19:38.865859 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-34780b60-987b-4d9e-bbe6-ca5f5cfc4332 tempest-VolumesActionsTest-1407931533 None] Created volume successfully. Oct 22 21:19:45.351198 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] Acquiring lock "cinder-201624cb-7374-478d-a393-3406988e013a-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:19:45.365041 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] Lock "cinder-201624cb-7374-478d-a393-3406988e013a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:19:45.477534 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:45.564197 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:19:45.564623 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] Volume volume-201624cb-7374-478d-a393-3406988e013a is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:19:45.579087 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] deleting rbd volume volume-201624cb-7374-478d-a393-3406988e013a {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:19:46.042516 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] Created reservations ['b00d1da6-122e-41e9-9fad-569378d3da9d', '6a6735d3-c263-48e0-8732-032a173bf5c7', 'b51fcb9f-5653-4e85-9ed1-6870872b38ee', '0832c2e7-5690-41ea-8bc3-8debc99e1102'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:19:46.157034 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:46.249149 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:46.333280 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:19:46.338532 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] Deleted volume successfully. Oct 22 21:19:46.357520 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ceec3156-4cc2-4a07-be45-ab01125e18c3 tempest-ServersNegativeTestJSON-766586991 None] Lock "cinder-201624cb-7374-478d-a393-3406988e013a-delete_volume" released by "delete_volume" :: held 0.992s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:19:46.628805 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] Acquiring lock "cinder-3eaddf40-8188-4b1b-980a-3be0b9b0e509-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:19:46.672208 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] Lock "cinder-3eaddf40-8188-4b1b-980a-3be0b9b0e509-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:19:46.827168 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:46.931587 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:19:46.932010 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] Volume volume-3eaddf40-8188-4b1b-980a-3be0b9b0e509 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:19:46.951490 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] deleting rbd volume volume-3eaddf40-8188-4b1b-980a-3be0b9b0e509 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:19:47.386059 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] Created reservations ['4387b9bf-09b4-4e0c-8ea9-321ff8c756e5', '040905e2-d028-41ff-a9f1-f6a427bebd30', '0fc18863-9590-4c5d-bd13-55a85598e4d1', '1af255d3-1e15-45c4-b67e-4fb56e259d23'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:19:47.448150 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:47.508182 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:19:47.577103 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:19:47.582027 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] Deleted volume successfully. Oct 22 21:19:47.621360 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-94e15b74-471d-42a6-9e0b-4dc15a3988f5 tempest-ServersNegativeTestJSON-766586991 None] Lock "cinder-3eaddf40-8188-4b1b-980a-3be0b9b0e509-delete_volume" released by "delete_volume" :: held 0.950s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:19:55.933382 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7f6c84ed-a113-4b13-a8f0-f480ad7a718b tempest-VolumesActionsTest-1407931533 None] Acquiring lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e" by "attach_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:19:55.944806 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7f6c84ed-a113-4b13-a8f0-f480ad7a718b tempest-VolumesActionsTest-1407931533 None] Lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e" acquired by "attach_volume" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:19:55.954423 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=55,cinder:INSERT=5,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:19:55.994840 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7f6c84ed-a113-4b13-a8f0-f480ad7a718b tempest-VolumesActionsTest-1407931533 None] Attaching volume 82794278-847a-4708-a6e5-c881dc3ec19e to instance 7c614e45-6138-43f4-85a5-303093b91055 at mountpoint /dev/sdb on host None. Oct 22 21:19:56.025014 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7f6c84ed-a113-4b13-a8f0-f480ad7a718b tempest-VolumesActionsTest-1407931533 None] Attach volume completed successfully. Oct 22 21:19:56.029809 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7f6c84ed-a113-4b13-a8f0-f480ad7a718b tempest-VolumesActionsTest-1407931533 None] Lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e" released by "attach_volume" :: held 0.086s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:19:56.153600 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ebe5872a-0b23-44e3-b550-b1075c6c766f tempest-VolumesActionsTest-1407931533 None] Acquiring lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e-detach_volume" by "detach_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:19:56.165358 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ebe5872a-0b23-44e3-b550-b1075c6c766f tempest-VolumesActionsTest-1407931533 None] Lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:19:56.166018 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-ebe5872a-0b23-44e3-b550-b1075c6c766f tempest-VolumesActionsTest-1407931533 None] Detaching volume 82794278-847a-4708-a6e5-c881dc3ec19e from instance 7c614e45-6138-43f4-85a5-303093b91055. Oct 22 21:19:56.245185 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-ebe5872a-0b23-44e3-b550-b1075c6c766f tempest-VolumesActionsTest-1407931533 None] Detach volume completed successfully. Oct 22 21:19:56.253133 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ebe5872a-0b23-44e3-b550-b1075c6c766f tempest-VolumesActionsTest-1407931533 None] Lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:06.958976 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=24,cinder:SELECT=47,cinder:DELETE=2,cinder:INSERT=8 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:14.145020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:20:14.173552 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Flow 'volume_create_manager' (d1b8fc70-d54a-4597-9d11-15aa6c39cc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:20:14.183240 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96403b6-0499-4839-8426-d9b286072dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:14.210057 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96403b6-0499-4839-8426-d9b286072dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1963488603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=28893b85-13e6-4393-95f1-0222913489bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2772f8564114025afc0ecae0e56fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:20:14Z,use_quota=True,user_id='b8df874d665a4a4cbbdbb4f881b6f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:14.217414 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d42a98b-0e03-4076-9e77-072b93942cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:14.222391 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d42a98b-0e03-4076-9e77-072b93942cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:14.232469 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55684036-db86-413f-bdd3-6e3b78525dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:14.239957 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55684036-db86-413f-bdd3-6e3b78525dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28893b85-13e6-4393-95f1-0222913489bc', 'volume_name': 'volume-28893b85-13e6-4393-95f1-0222913489bc', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:14.246324 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5eac38a-1dcf-40d6-96a6-7a5d4e6d42c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:14.251563 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5eac38a-1dcf-40d6-96a6-7a5d4e6d42c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:14.258950 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f0af86-bfe7-40d6-a701-2506a26f3c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:14.265595 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Volume 28893b85-13e6-4393-95f1-0222913489bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28893b85-13e6-4393-95f1-0222913489bc', 'volume_size': 1} Oct 22 21:20:14.277367 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] creating volume 'volume-28893b85-13e6-4393-95f1-0222913489bc' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:20:14.278893 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:14.433682 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:20:14.434621 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:20:14.440565 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f0af86-bfe7-40d6-a701-2506a26f3c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28893b85-13e6-4393-95f1-0222913489bc', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:14.454209 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3c2652-0bfd-46f9-94ea-c1416b95c0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:14.475940 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Volume volume-28893b85-13e6-4393-95f1-0222913489bc (28893b85-13e6-4393-95f1-0222913489bc): created successfully Oct 22 21:20:14.485712 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3c2652-0bfd-46f9-94ea-c1416b95c0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:14.503583 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Flow 'volume_create_manager' (d1b8fc70-d54a-4597-9d11-15aa6c39cc25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:20:14.528859 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6504a345-4897-4a9a-9752-762feaefc527 tempest-SnapshotsActionsTest-1289586846 None] Created volume successfully. Oct 22 21:20:15.430271 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-f731b217-c1d3-4d56-869f-a6cbfc90b321 tempest-SnapshotsActionsTest-1289586846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:15.964482 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f731b217-c1d3-4d56-869f-a6cbfc90b321 tempest-SnapshotsActionsTest-1289586846 None] Create snapshot completed successfully Oct 22 21:20:17.203589 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-95e9efcb-2fc9-476c-b214-5e92cb8132cf tempest-SnapshotsActionsTest-1289586846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:17.708599 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f40969ff-3586-4afd-a43a-f3e15e85865f tempest-VolumesActionsTest-1407931533 None] Acquiring lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e" by "attach_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:17.726580 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f40969ff-3586-4afd-a43a-f3e15e85865f tempest-VolumesActionsTest-1407931533 None] Lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e" acquired by "attach_volume" :: waited 0.018s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:17.832715 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f40969ff-3586-4afd-a43a-f3e15e85865f tempest-VolumesActionsTest-1407931533 None] Attaching volume 82794278-847a-4708-a6e5-c881dc3ec19e to instance cbdf6f32-0fbe-4fc0-89c3-7108862f56ac at mountpoint /dev/sdb on host None. Oct 22 21:20:17.863611 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-f40969ff-3586-4afd-a43a-f3e15e85865f tempest-VolumesActionsTest-1407931533 None] Attach volume completed successfully. Oct 22 21:20:17.872397 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-f40969ff-3586-4afd-a43a-f3e15e85865f tempest-VolumesActionsTest-1407931533 None] Lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e" released by "attach_volume" :: held 0.145s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:18.044614 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-95e9efcb-2fc9-476c-b214-5e92cb8132cf tempest-SnapshotsActionsTest-1289586846 None] Create snapshot completed successfully Oct 22 21:20:18.282319 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3da754a1-90ab-4832-bb99-df58e7257383 tempest-VolumesActionsTest-1407931533 None] Acquiring lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e-detach_volume" by "detach_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:18.297786 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3da754a1-90ab-4832-bb99-df58e7257383 tempest-VolumesActionsTest-1407931533 None] Lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:18.299222 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-3da754a1-90ab-4832-bb99-df58e7257383 tempest-VolumesActionsTest-1407931533 None] Detaching volume 82794278-847a-4708-a6e5-c881dc3ec19e from instance cbdf6f32-0fbe-4fc0-89c3-7108862f56ac. Oct 22 21:20:18.390727 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-3da754a1-90ab-4832-bb99-df58e7257383 tempest-VolumesActionsTest-1407931533 None] Detach volume completed successfully. Oct 22 21:20:18.401851 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3da754a1-90ab-4832-bb99-df58e7257383 tempest-VolumesActionsTest-1407931533 None] Lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:18.640605 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d4732195-ec07-4469-a092-436c4f240c16 tempest-SnapshotsActionsTest-678788786 None] Acquiring lock "cinder-0546cdce-6d39-4649-91a6-ecb5461afa8f-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:18.651837 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d4732195-ec07-4469-a092-436c4f240c16 tempest-SnapshotsActionsTest-678788786 None] Lock "cinder-0546cdce-6d39-4649-91a6-ecb5461afa8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:18.654189 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d4732195-ec07-4469-a092-436c4f240c16 tempest-SnapshotsActionsTest-678788786 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:19.831551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-d4732195-ec07-4469-a092-436c4f240c16 tempest-SnapshotsActionsTest-678788786 None] Created reservations ['04b73aa0-14cf-417f-80c0-2e556b2a017b', '9bb707a3-7f5f-4f45-9c37-e45cd6c7c5c3', 'ee29b022-f9a7-4ee0-97b4-9b0c607ffa21', '7ee6a83f-58a5-4cdd-94d4-b2365a54d433'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:20:19.894648 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d4732195-ec07-4469-a092-436c4f240c16 tempest-SnapshotsActionsTest-678788786 None] Delete snapshot completed successfully. Oct 22 21:20:19.904334 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d4732195-ec07-4469-a092-436c4f240c16 tempest-SnapshotsActionsTest-678788786 None] Lock "cinder-0546cdce-6d39-4649-91a6-ecb5461afa8f-delete_snapshot" released by "delete_snapshot" :: held 1.250s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:21.283801 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c7369d2-b72f-4435-809f-5d46901ee636 tempest-SnapshotsActionsTest-1289586846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:22.214397 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5c7369d2-b72f-4435-809f-5d46901ee636 tempest-SnapshotsActionsTest-1289586846 None] Create snapshot completed successfully Oct 22 21:20:22.495512 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-975cc6a8-978d-4a74-b866-af074107d684 tempest-SnapshotsActionsTest-678788786 None] Acquiring lock "cinder-a82155a9-4eea-441e-8047-bd923142fba0-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:22.510645 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-975cc6a8-978d-4a74-b866-af074107d684 tempest-SnapshotsActionsTest-678788786 None] Lock "cinder-a82155a9-4eea-441e-8047-bd923142fba0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:22.512238 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-975cc6a8-978d-4a74-b866-af074107d684 tempest-SnapshotsActionsTest-678788786 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:23.253313 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-975cc6a8-978d-4a74-b866-af074107d684 tempest-SnapshotsActionsTest-678788786 None] Created reservations ['00dd3a83-047d-49d4-bac2-9b7cc0b70024', 'f9c826a8-d314-4f7f-bd9e-f84d418a143f', '9d362d1c-4932-4b40-82a0-c63d80f885cd', '9eda4b23-c93c-4be9-aed8-8e036b8b2b7b'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:20:23.342959 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-975cc6a8-978d-4a74-b866-af074107d684 tempest-SnapshotsActionsTest-678788786 None] Delete snapshot completed successfully. Oct 22 21:20:23.352930 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-975cc6a8-978d-4a74-b866-af074107d684 tempest-SnapshotsActionsTest-678788786 None] Lock "cinder-a82155a9-4eea-441e-8047-bd923142fba0-delete_snapshot" released by "delete_snapshot" :: held 0.842s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:24.221628 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b2be2c3b-6edd-41d4-ab80-37e661e95f60 tempest-SnapshotsActionsTest-1289586846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:24.730763 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-d46b0ca5-6cf7-45d3-b9ed-c5ee78b872d2 tempest-VolumesActionsTest-1407931533 None] Running cmd (subprocess): rbd export --pool volumes volume-82794278-847a-4708-a6e5-c881dc3ec19e /opt/stack/data/cinder/conversion/volume-82794278-847a-4708-a6e5-c881dc3ec19e-486f2670-3945-4e09-ab5b-18c1b0ab5dcb --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:20:25.230569 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b2be2c3b-6edd-41d4-ab80-37e661e95f60 tempest-SnapshotsActionsTest-1289586846 None] Create snapshot completed successfully Oct 22 21:20:25.437556 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2b89c293-5d4a-40d0-ba94-b00a7c5d17cc tempest-SnapshotsActionsTest-678788786 None] Acquiring lock "cinder-c86e10ae-dd39-44da-a2fb-3b89cbcdd535-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:25.451206 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2b89c293-5d4a-40d0-ba94-b00a7c5d17cc tempest-SnapshotsActionsTest-678788786 None] Lock "cinder-c86e10ae-dd39-44da-a2fb-3b89cbcdd535-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:25.458998 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2b89c293-5d4a-40d0-ba94-b00a7c5d17cc tempest-SnapshotsActionsTest-678788786 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:25.773366 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-d46b0ca5-6cf7-45d3-b9ed-c5ee78b872d2 tempest-VolumesActionsTest-1407931533 None] CMD "rbd export --pool volumes volume-82794278-847a-4708-a6e5-c881dc3ec19e /opt/stack/data/cinder/conversion/volume-82794278-847a-4708-a6e5-c881dc3ec19e-486f2670-3945-4e09-ab5b-18c1b0ab5dcb --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.043s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:20:25.793884 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.image_utils [None req-d46b0ca5-6cf7-45d3-b9ed-c5ee78b872d2 tempest-VolumesActionsTest-1407931533 None] 486f2670-3945-4e09-ab5b-18c1b0ab5dcb was raw, no need to convert to raw {{(pid=131630) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:851}} Oct 22 21:20:26.222157 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=68,cinder:UPDATE=14,cinder:DELETE=4,cinder:INSERT=10 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:26.271273 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-2b89c293-5d4a-40d0-ba94-b00a7c5d17cc tempest-SnapshotsActionsTest-678788786 None] Created reservations ['247a53dd-c9e0-40a5-a6e1-eed085be9ddf', '3232c0f3-ca8c-48d9-93b0-38a2da8d51ec', 'c82635b3-b4d6-4ff3-bd6e-41e06b5b2085', '07812c31-e2ad-4f74-96bd-d7acf940426f'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:20:26.309306 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=63,cinder:UPDATE=35,cinder:DELETE=1,cinder:INSERT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:26.325890 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2b89c293-5d4a-40d0-ba94-b00a7c5d17cc tempest-SnapshotsActionsTest-678788786 None] Delete snapshot completed successfully. Oct 22 21:20:26.335912 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-2b89c293-5d4a-40d0-ba94-b00a7c5d17cc tempest-SnapshotsActionsTest-678788786 None] Lock "cinder-c86e10ae-dd39-44da-a2fb-3b89cbcdd535-delete_snapshot" released by "delete_snapshot" :: held 0.883s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:26.961430 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cd50e527-0bbe-483b-8ad8-1ef77341e6d5 tempest-SnapshotsActionsTest-1289586846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:27.312456 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-cd50e527-0bbe-483b-8ad8-1ef77341e6d5 tempest-SnapshotsActionsTest-1289586846 None] Create snapshot completed successfully Oct 22 21:20:28.253671 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-98a41931-c776-497d-b16e-bb456aee2afd tempest-SnapshotsActionsTest-678788786 None] Acquiring lock "cinder-d68c48a6-d818-47e6-b866-b097704200a5-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:28.267071 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-98a41931-c776-497d-b16e-bb456aee2afd tempest-SnapshotsActionsTest-678788786 None] Lock "cinder-d68c48a6-d818-47e6-b866-b097704200a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:28.268967 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-98a41931-c776-497d-b16e-bb456aee2afd tempest-SnapshotsActionsTest-678788786 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:28.774411 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-98a41931-c776-497d-b16e-bb456aee2afd tempest-SnapshotsActionsTest-678788786 None] Created reservations ['9b297d5f-23cb-48dd-9e52-f634b2c856c2', 'c22672e2-a0ad-47d5-8b8d-804a090e6b19', '973d6cfc-14ee-442e-9ec9-c704ef50b368', 'a75a20c5-44ce-412c-8522-5595906a26f6'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:20:28.821851 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-98a41931-c776-497d-b16e-bb456aee2afd tempest-SnapshotsActionsTest-678788786 None] Delete snapshot completed successfully. Oct 22 21:20:28.833324 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-98a41931-c776-497d-b16e-bb456aee2afd tempest-SnapshotsActionsTest-678788786 None] Lock "cinder-d68c48a6-d818-47e6-b866-b097704200a5-delete_snapshot" released by "delete_snapshot" :: held 0.566s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:30.181491 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-af17b995-021a-477f-82f2-3f215d9a0e3c tempest-SnapshotsActionsTest-1289586846 None] Acquiring lock "cinder-386269cb-9534-4b27-9715-3dcff0f456f4-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:30.197708 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-af17b995-021a-477f-82f2-3f215d9a0e3c tempest-SnapshotsActionsTest-1289586846 None] Lock "cinder-386269cb-9534-4b27-9715-3dcff0f456f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:30.200692 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-af17b995-021a-477f-82f2-3f215d9a0e3c tempest-SnapshotsActionsTest-1289586846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:30.510207 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:20:30.512420 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:30.562101 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:30.614920 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:20:30.822380 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-af17b995-021a-477f-82f2-3f215d9a0e3c tempest-SnapshotsActionsTest-1289586846 None] Created reservations ['a39fec36-5f30-4ab0-99d1-83dc3495febb', '28f4946a-8287-411a-b054-f594759c211c', '6b69c337-3d2c-4d53-8782-f25f86300d88', '5b717d10-fc3c-496e-9db2-bc5e6c29499a'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:20:30.878328 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-af17b995-021a-477f-82f2-3f215d9a0e3c tempest-SnapshotsActionsTest-1289586846 None] Delete snapshot completed successfully. Oct 22 21:20:30.883793 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-af17b995-021a-477f-82f2-3f215d9a0e3c tempest-SnapshotsActionsTest-1289586846 None] Lock "cinder-386269cb-9534-4b27-9715-3dcff0f456f4-delete_snapshot" released by "delete_snapshot" :: held 0.687s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:31.594088 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] Acquiring lock "cinder-28893b85-13e6-4393-95f1-0222913489bc-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:31.618101 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] Lock "cinder-28893b85-13e6-4393-95f1-0222913489bc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:31.731116 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:31.813511 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:20:31.813889 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] Volume volume-28893b85-13e6-4393-95f1-0222913489bc is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:20:31.823236 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] deleting rbd volume volume-28893b85-13e6-4393-95f1-0222913489bc {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:20:32.237153 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] Created reservations ['ba97c7dc-c2a9-4f31-ae55-dfc61d78ed01', 'ffed9d64-58f1-4f0d-8bc7-d2b280f18f94', 'fbba25c6-c075-4985-85ca-e795a93cdd0f', 'a1a227f5-a254-408b-91cb-40f090936d17'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:20:32.308946 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:32.364884 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:32.403863 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:20:32.415654 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] Deleted volume successfully. Oct 22 21:20:32.433652 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7fb198eb-102f-4d22-95cf-2e2ef56821c1 tempest-SnapshotsActionsTest-1289586846 None] Lock "cinder-28893b85-13e6-4393-95f1-0222913489bc-delete_volume" released by "delete_volume" :: held 0.816s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:40.229780 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:20:40.261093 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Flow 'volume_create_manager' (f547de63-234c-4d4a-979f-4dfb5067653f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:20:40.269564 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a517018-1b50-45f4-841f-702a15a65d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:40.295067 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a517018-1b50-45f4-841f-702a15a65d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1019204789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=46b87ff8-56c6-46a4-875a-b7d170aa86bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0162f66026e240479f14a75f918693ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:20:40Z,use_quota=True,user_id='b904e6c748a24a299393515eb5b90fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:40.303570 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715047f5-d589-499c-8d4a-9051e2cdc74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:40.309521 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715047f5-d589-499c-8d4a-9051e2cdc74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:40.316842 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018b8bc5-f8e0-4280-8b88-a1c993ce6dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:40.530125 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018b8bc5-f8e0-4280-8b88-a1c993ce6dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '46b87ff8-56c6-46a4-875a-b7d170aa86bd', 'volume_name': 'volume-46b87ff8-56c6-46a4-875a-b7d170aa86bd', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:40.536925 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a52a96-7540-44d4-9ea5-66ca1f1d11cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:40.542226 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a52a96-7540-44d4-9ea5-66ca1f1d11cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:40.549046 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a760182c-1ec7-49bf-bd76-e0fe80585ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:40.550434 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Volume 46b87ff8-56c6-46a4-875a-b7d170aa86bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-46b87ff8-56c6-46a4-875a-b7d170aa86bd', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 21:20:40.551264 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Cloning 46b87ff8-56c6-46a4-875a-b7d170aa86bd from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 21:20:40.552227 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:40.565051 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:40.580017 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 20, 40, 569676)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:20:40.580812 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:20:40.581540 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 21:20:40.588365 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:40.589432 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 21:20:40.597289 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 20, 40, 593659)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:20:40.597995 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:20:40.598634 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 21:20:40.613707 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:40.806987 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] creating snapshot='volume-46b87ff8-56c6-46a4-875a-b7d170aa86bd.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:20:41.877403 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-46b87ff8-56c6-46a4-875a-b7d170aa86bd.clone_snap' to 'volume-46b87ff8-56c6-46a4-875a-b7d170aa86bd' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:20:42.158469 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:20:42.160202 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:20:42.160681 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:20:42.202496 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:20:42.204196 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Marking volume 46b87ff8-56c6-46a4-875a-b7d170aa86bd as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:20:42.224046 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to 46b87ff8-56c6-46a4-875a-b7d170aa86bd. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 21:20:42.224964 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Creating volume glance metadata for volume 46b87ff8-56c6-46a4-875a-b7d170aa86bd backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 21:20:42.280976 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=53,cinder:INSERT=14,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:42.329833 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a760182c-1ec7-49bf-bd76-e0fe80585ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b87ff8-56c6-46a4-875a-b7d170aa86bd', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:42.334492 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55a1bd0-7cc2-437a-85ee-7ba812296648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:42.349207 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Volume volume-46b87ff8-56c6-46a4-875a-b7d170aa86bd (46b87ff8-56c6-46a4-875a-b7d170aa86bd): created successfully Oct 22 21:20:42.353882 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55a1bd0-7cc2-437a-85ee-7ba812296648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:42.361615 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Flow 'volume_create_manager' (f547de63-234c-4d4a-979f-4dfb5067653f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:20:42.375130 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-33427e0b-52ba-458d-beb9-9407888f6f3d tempest-VolumesImageMetadata-1379205870 None] Created volume successfully. Oct 22 21:20:44.183804 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] Acquiring lock "cinder-46b87ff8-56c6-46a4-875a-b7d170aa86bd-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:44.196453 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] Lock "cinder-46b87ff8-56c6-46a4-875a-b7d170aa86bd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:44.264652 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:44.371689 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:20:44.388615 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] deleting rbd volume volume-46b87ff8-56c6-46a4-875a-b7d170aa86bd {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:20:44.752468 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:20:44.815756 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] deleting parent snapshot volume-46b87ff8-56c6-46a4-875a-b7d170aa86bd.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:20:45.978713 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=61,cinder:DELETE=2,cinder:INSERT=15,cinder:UPDATE=22 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:45.994400 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] Created reservations ['e796652f-f832-4044-a6c9-c2725df2d9c5', 'adfdc874-3b5c-46b4-aa80-03a928574a26', '348195ed-4a25-43dd-8609-18f51f99fccb', '2cdadbb0-dbb4-4386-ab6d-26ceede905a0'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:20:46.069567 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:46.119623 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:46.154592 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:20:46.160649 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] Deleted volume successfully. Oct 22 21:20:46.182445 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-3e068258-d72b-4820-8587-4954a00e5df1 tempest-VolumesImageMetadata-1379205870 None] Lock "cinder-46b87ff8-56c6-46a4-875a-b7d170aa86bd-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:52.195792 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:20:52.221161 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Flow 'volume_create_manager' (310148b2-11ef-4a48-b15d-35d1210005f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:20:52.229454 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1927625a-2710-42e4-abbc-8b49524cd06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:52.248353 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1927625a-2710-42e4-abbc-8b49524cd06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-13398193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a07d7d81-18d1-4201-9f56-b89a25fc81fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7815e8cbbe0046aab74699f8f970e941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:20:52Z,use_quota=True,user_id='e2ceb70dbe464184a28b92bb4b5e4d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:52.255087 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661db94d-b1fe-4741-a4ee-fd5fb322bb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:52.259974 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661db94d-b1fe-4741-a4ee-fd5fb322bb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:52.266118 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4de111-0ffb-4c9d-9446-dc76d787685b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:52.272790 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4de111-0ffb-4c9d-9446-dc76d787685b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a07d7d81-18d1-4201-9f56-b89a25fc81fd', 'volume_name': 'volume-a07d7d81-18d1-4201-9f56-b89a25fc81fd', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:52.278105 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cc25cb-763a-4596-b700-1aebc522f229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:52.283930 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cc25cb-763a-4596-b700-1aebc522f229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:52.288688 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033df323-44e8-45f6-b3f4-aad26fd637c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:52.290298 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Volume a07d7d81-18d1-4201-9f56-b89a25fc81fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a07d7d81-18d1-4201-9f56-b89a25fc81fd', 'volume_size': 1} Oct 22 21:20:52.291316 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] creating volume 'volume-a07d7d81-18d1-4201-9f56-b89a25fc81fd' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:20:52.292543 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:52.405159 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:20:52.405631 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:20:52.409484 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033df323-44e8-45f6-b3f4-aad26fd637c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a07d7d81-18d1-4201-9f56-b89a25fc81fd', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:52.418785 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef93f5ef-f2e0-4bf8-9b1a-055193254a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:52.435079 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Volume volume-a07d7d81-18d1-4201-9f56-b89a25fc81fd (a07d7d81-18d1-4201-9f56-b89a25fc81fd): created successfully Oct 22 21:20:52.440001 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef93f5ef-f2e0-4bf8-9b1a-055193254a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:52.446173 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Flow 'volume_create_manager' (310148b2-11ef-4a48-b15d-35d1210005f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:20:52.460380 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-09f8373e-37c5-4dde-96ee-700818408446 tempest-VolumesTransfersTest-111691046 None] Created volume successfully. Oct 22 21:20:52.886348 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d46b0ca5-6cf7-45d3-b9ed-c5ee78b872d2 tempest-VolumesActionsTest-1407931533 None] Uploaded volume to glance image-id: 486f2670-3945-4e09-ab5b-18c1b0ab5dcb. {{(pid=131630) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1791}} Oct 22 21:20:52.907991 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d46b0ca5-6cf7-45d3-b9ed-c5ee78b872d2 tempest-VolumesActionsTest-1407931533 None] Copy volume to image completed successfully. Oct 22 21:20:52.971998 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:20:52.992401 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Flow 'volume_create_manager' (3dc0dc21-be87-40d1-b0da-87b25b84e993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:20:52.999204 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdd3d3b-76a0-46ad-8bc1-d6526fc57603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:53.015085 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdd3d3b-76a0-46ad-8bc1-d6526fc57603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1156696081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=26ae2ccb-78e1-45c7-a98a-8f07fca7729f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1814af9a0d8d48e0b73dbfde03d495b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:20:53Z,use_quota=True,user_id='b9248fe1a6fc4fe995378573e5f55b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:53.020226 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2148721c-b3ae-4b3a-bf1a-192d384c6c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:53.026402 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2148721c-b3ae-4b3a-bf1a-192d384c6c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:53.031483 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdeea07-68ff-4266-bb6e-ab0f9bbd62dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:53.035383 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdeea07-68ff-4266-bb6e-ab0f9bbd62dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ae2ccb-78e1-45c7-a98a-8f07fca7729f', 'volume_name': 'volume-26ae2ccb-78e1-45c7-a98a-8f07fca7729f', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:53.039994 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94a684d-4541-49c8-8e42-b4f54593a881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:53.043692 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94a684d-4541-49c8-8e42-b4f54593a881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:53.048372 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795480f1-026a-4ff1-8bd7-d1c8e10f8f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:53.049415 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Volume 26ae2ccb-78e1-45c7-a98a-8f07fca7729f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ae2ccb-78e1-45c7-a98a-8f07fca7729f', 'volume_size': 1} Oct 22 21:20:53.049806 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] creating volume 'volume-26ae2ccb-78e1-45c7-a98a-8f07fca7729f' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:20:53.050459 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:53.116900 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:20:53.117344 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:20:53.121538 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795480f1-026a-4ff1-8bd7-d1c8e10f8f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ae2ccb-78e1-45c7-a98a-8f07fca7729f', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:53.126652 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5fcbdc1-1330-41a9-805b-443303e988e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:53.141829 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Volume volume-26ae2ccb-78e1-45c7-a98a-8f07fca7729f (26ae2ccb-78e1-45c7-a98a-8f07fca7729f): created successfully Oct 22 21:20:53.146579 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5fcbdc1-1330-41a9-805b-443303e988e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:53.152495 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Flow 'volume_create_manager' (3dc0dc21-be87-40d1-b0da-87b25b84e993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:20:53.162530 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-0d1f12aa-4fa7-4f03-8b6f-d3a6aa332a7b req-63bf9a0d-5381-4248-8b49-1a325c1ab8a3 tempest-VolumesGetTestJSON-1888422140 None] Created volume successfully. Oct 22 21:20:53.658028 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] Acquiring lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:53.686116 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] Lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:53.727961 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:53.772685 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:20:53.773161 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] Volume volume-82794278-847a-4708-a6e5-c881dc3ec19e is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:20:53.778573 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] deleting rbd volume volume-82794278-847a-4708-a6e5-c881dc3ec19e {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:20:53.793517 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e715de8a-7d98-4872-bce2-2d43699a5610 tempest-VolumesTransfersTest-1251982509 None] Transfer volume completed successfully. Oct 22 21:20:54.013170 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] Created reservations ['b81f7777-8590-41d9-a38d-3e4c04587236', '8311393c-5ffd-4c55-9ccb-56cec89f654e', 'ce0e446f-2d04-458f-a0d8-aa6524990613', '50571c22-cf69-484d-a070-b057e1642b31'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:20:54.062916 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:54.105562 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:54.146827 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:20:54.154818 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] Deleted volume successfully. Oct 22 21:20:54.172174 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] Acquiring lock "cinder-26ae2ccb-78e1-45c7-a98a-8f07fca7729f-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:54.190343 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] Lock "cinder-26ae2ccb-78e1-45c7-a98a-8f07fca7729f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:54.190343 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-139a8492-3bb9-4781-8dc2-4679f7284779 tempest-VolumesActionsTest-1407931533 None] Lock "cinder-82794278-847a-4708-a6e5-c881dc3ec19e-delete_volume" released by "delete_volume" :: held 0.506s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:54.236443 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:54.280918 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:20:54.281724 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] Volume volume-26ae2ccb-78e1-45c7-a98a-8f07fca7729f is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:20:54.286919 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] deleting rbd volume volume-26ae2ccb-78e1-45c7-a98a-8f07fca7729f {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:20:54.291788 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] Acquiring lock "cinder-a07d7d81-18d1-4201-9f56-b89a25fc81fd-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:54.314075 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] Lock "cinder-a07d7d81-18d1-4201-9f56-b89a25fc81fd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:54.340922 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:54.376898 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:20:54.377373 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] Volume volume-a07d7d81-18d1-4201-9f56-b89a25fc81fd is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:20:54.381036 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] deleting rbd volume volume-a07d7d81-18d1-4201-9f56-b89a25fc81fd {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:20:54.488683 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] Created reservations ['20e0f393-42dc-4c11-b346-72f507b537a5', 'cc3879f4-9851-4797-a1b6-78a9df4a7620', 'd670a4fa-8317-4976-93c6-6fd5f8fe3841', '16417d10-d8a8-42ec-85ea-4dbdc692441a'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:20:54.538317 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:54.572940 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:54.600945 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:20:54.608091 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] Deleted volume successfully. Oct 22 21:20:54.628254 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-43f01aad-e49d-45d2-92ad-64c5de6a0708 req-ae86d307-a48a-48ed-b5d0-eb66d2efbea0 tempest-VolumesGetTestJSON-1888422140 None] Lock "cinder-26ae2ccb-78e1-45c7-a98a-8f07fca7729f-delete_volume" released by "delete_volume" :: held 0.443s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:54.646979 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] Created reservations ['ff2f0ee7-f870-4a95-b2df-2ab4220e7d8e', 'ca75e100-b695-4a3c-8f6f-ed1bd0c2691d', 'e57f44de-0ad6-40c4-8fe4-d76fa9b0f83c', '5f38e6dc-f4fd-4949-83c0-536679cb8172'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:20:54.658654 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=55,cinder:INSERT=9,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:54.695753 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:54.722864 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:54.752092 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:20:54.756429 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] Deleted volume successfully. Oct 22 21:20:54.769542 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-0b5f8867-b9d5-4fb3-93ee-26c0a61cd6f6 tempest-VolumesTransfersTest-259442782 None] Lock "cinder-a07d7d81-18d1-4201-9f56-b89a25fc81fd-delete_volume" released by "delete_volume" :: held 0.459s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:20:55.754232 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:20:55.780644 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Flow 'volume_create_manager' (fb273975-7360-4eb3-9974-e7eeed5b4ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:20:55.790712 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedf60a0-a986-4971-816c-357773c9ed00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:55.797292 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=57,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:20:55.822923 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedf60a0-a986-4971-816c-357773c9ed00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-485894390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=06456a01-6033-4a1f-a911-71dbc0deae37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7815e8cbbe0046aab74699f8f970e941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:20:56Z,use_quota=True,user_id='e2ceb70dbe464184a28b92bb4b5e4d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:55.829474 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf169a1-af5d-4265-b2db-136f7acb9021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:55.833656 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf169a1-af5d-4265-b2db-136f7acb9021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:55.838747 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f52ad4e-4923-492b-b700-8022ae82e114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:55.843563 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f52ad4e-4923-492b-b700-8022ae82e114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06456a01-6033-4a1f-a911-71dbc0deae37', 'volume_name': 'volume-06456a01-6033-4a1f-a911-71dbc0deae37', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:55.848458 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67115f81-3536-4580-9dce-e568d1a0ab88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:55.853520 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67115f81-3536-4580-9dce-e568d1a0ab88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:55.859669 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969be2b8-403b-446b-b213-2d4a48ac5642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:55.860690 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Volume 06456a01-6033-4a1f-a911-71dbc0deae37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06456a01-6033-4a1f-a911-71dbc0deae37', 'volume_size': 1} Oct 22 21:20:55.861222 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] creating volume 'volume-06456a01-6033-4a1f-a911-71dbc0deae37' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:20:55.862975 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:55.947390 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:20:55.948128 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:20:55.952041 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969be2b8-403b-446b-b213-2d4a48ac5642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06456a01-6033-4a1f-a911-71dbc0deae37', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:55.957541 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70439a91-68f3-4300-95fa-da50474e004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:20:55.970599 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Volume volume-06456a01-6033-4a1f-a911-71dbc0deae37 (06456a01-6033-4a1f-a911-71dbc0deae37): created successfully Oct 22 21:20:55.976275 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70439a91-68f3-4300-95fa-da50474e004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:20:55.984263 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Flow 'volume_create_manager' (fb273975-7360-4eb3-9974-e7eeed5b4ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:20:55.999798 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2b87a9f8-fb86-467a-88d0-5cc9538021ba tempest-VolumesTransfersTest-111691046 None] Created volume successfully. Oct 22 21:20:57.136855 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] Acquiring lock "cinder-06456a01-6033-4a1f-a911-71dbc0deae37-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:20:57.151389 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] Lock "cinder-06456a01-6033-4a1f-a911-71dbc0deae37-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:20:57.202565 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:57.287332 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:20:57.287938 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] Volume volume-06456a01-6033-4a1f-a911-71dbc0deae37 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:20:57.293393 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] deleting rbd volume volume-06456a01-6033-4a1f-a911-71dbc0deae37 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:20:57.559840 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] Created reservations ['254ec8a2-d38b-4225-9d0a-d2c1a12ff40a', '4af719cd-18db-49c8-af3f-79218ae92d63', 'bd8a9b5f-0ec2-40c0-882d-21bdbd0c4ac7', '050759b0-7de3-4b15-9f4d-9abb87d0cb6c'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:20:57.619766 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:57.674778 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:20:57.745555 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:20:57.750761 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] Deleted volume successfully. Oct 22 21:20:57.769769 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-6a4f643c-efd3-4bcd-93b7-e91873327c26 tempest-VolumesTransfersTest-259442782 None] Lock "cinder-06456a01-6033-4a1f-a911-71dbc0deae37-delete_volume" released by "delete_volume" :: held 0.619s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:21:04.216443 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:21:04.248691 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Flow 'volume_create_manager' (4d381179-b6f7-4ee8-8db5-dfcd6b432273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:21:04.256475 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f821250d-1ace-448b-8f00-6fa7bd530a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:04.295214 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f821250d-1ace-448b-8f00-6fa7bd530a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-984518572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9d85629f-d3c6-40b5-8477-274bff292f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45bd36b7f89a4c358c41ac518a672206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:21:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:21:04Z,use_quota=True,user_id='ec773aad9a5747d3b1d0f9dd359f2dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:04.302508 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac5c2da-07a4-43e0-968e-d562081a0771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:04.308728 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac5c2da-07a4-43e0-968e-d562081a0771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:04.314714 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e062858-7716-41cb-b420-8a581b950eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:04.319651 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e062858-7716-41cb-b420-8a581b950eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d85629f-d3c6-40b5-8477-274bff292f80', 'volume_name': 'volume-9d85629f-d3c6-40b5-8477-274bff292f80', 'volume_size': 2}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:04.324959 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896ebdc9-1696-4204-8034-2fbd1b2eaa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:04.329556 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896ebdc9-1696-4204-8034-2fbd1b2eaa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:04.334215 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb01790-9828-420f-9c81-370453ba18b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:04.335300 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Volume 9d85629f-d3c6-40b5-8477-274bff292f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d85629f-d3c6-40b5-8477-274bff292f80', 'volume_size': 2} Oct 22 21:21:04.335969 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] creating volume 'volume-9d85629f-d3c6-40b5-8477-274bff292f80' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:21:04.336971 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:04.438082 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:21:04.438769 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:21:04.442867 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb01790-9828-420f-9c81-370453ba18b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d85629f-d3c6-40b5-8477-274bff292f80', 'volume_size': 2}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:04.447862 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1110f95-42e2-403e-ab7e-0c04259e0281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:04.462011 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Volume volume-9d85629f-d3c6-40b5-8477-274bff292f80 (9d85629f-d3c6-40b5-8477-274bff292f80): created successfully Oct 22 21:21:04.469230 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1110f95-42e2-403e-ab7e-0c04259e0281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:04.477641 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Flow 'volume_create_manager' (4d381179-b6f7-4ee8-8db5-dfcd6b432273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:21:04.494774 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-447642a4-2a7c-4047-9102-c8ae359c8809 tempest-VolumesCloneNegativeTest-1889994324 None] Created volume successfully. Oct 22 21:21:05.427615 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] Acquiring lock "cinder-9d85629f-d3c6-40b5-8477-274bff292f80-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:21:05.454744 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] Lock "cinder-9d85629f-d3c6-40b5-8477-274bff292f80-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:21:05.550594 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:05.615243 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:21:05.615748 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] Volume volume-9d85629f-d3c6-40b5-8477-274bff292f80 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:21:05.626025 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] deleting rbd volume volume-9d85629f-d3c6-40b5-8477-274bff292f80 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:21:06.093725 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] Created reservations ['eb1c0799-7ecf-4ad5-a17c-59a455d6aa00', '7323ddb0-a5d6-4eef-a50e-c432e2423375', '208f88b5-aed0-4d18-a9cd-ae9e0586867c', '22f4d103-f8c5-4775-8c71-cb6c9449032c'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:21:06.203651 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:06.305166 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:06.400492 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:21:06.405453 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] Deleted volume successfully. Oct 22 21:21:06.426645 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-cd1a9cc5-1cdf-46b3-ba31-959404e7d2a7 tempest-VolumesCloneNegativeTest-1889994324 None] Lock "cinder-9d85629f-d3c6-40b5-8477-274bff292f80-delete_volume" released by "delete_volume" :: held 0.977s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:21:10.359748 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:21:10.381055 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Flow 'volume_create_manager' (7275230a-ac03-4608-acdf-5eabf2bb47fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:21:10.387017 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98121cfc-e7aa-42d9-b4cd-b5a3fded19df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:10.406096 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98121cfc-e7aa-42d9-b4cd-b5a3fded19df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1418103559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=30f31fc1-79d9-4f97-8800-85fb096526b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0a1cbb3f9c44589e03fcea570a1ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:21:10Z,use_quota=True,user_id='0664c9ee16b843069a8ac4e87acfb65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:10.411260 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ee40a0-0a04-4511-a77c-49beb09f2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:10.417378 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ee40a0-0a04-4511-a77c-49beb09f2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:10.423517 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed672a1-286a-4a90-8e31-14abc7b28023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:10.536805 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed672a1-286a-4a90-8e31-14abc7b28023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30f31fc1-79d9-4f97-8800-85fb096526b0', 'volume_name': 'volume-30f31fc1-79d9-4f97-8800-85fb096526b0', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:10.542126 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aded8460-8f17-4264-9139-1f8f6128eea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:10.546197 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aded8460-8f17-4264-9139-1f8f6128eea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:10.550664 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ebec62-0998-4128-a125-dce97817e1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:10.551813 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Volume 30f31fc1-79d9-4f97-8800-85fb096526b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30f31fc1-79d9-4f97-8800-85fb096526b0', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 21:21:10.552381 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Cloning 30f31fc1-79d9-4f97-8800-85fb096526b0 from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 21:21:10.553119 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:21:10.561842 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:21:10.574161 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 21, 10, 566029)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:21:10.574584 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:21:10.575015 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 21:21:10.579798 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:21:10.580733 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 21:21:10.587866 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 21, 10, 584711)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:21:10.588292 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:21:10.588696 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 21:21:10.605112 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:10.717846 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] creating snapshot='volume-30f31fc1-79d9-4f97-8800-85fb096526b0.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:21:11.115120 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-30f31fc1-79d9-4f97-8800-85fb096526b0.clone_snap' to 'volume-30f31fc1-79d9-4f97-8800-85fb096526b0' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:21:11.287140 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:21:11.288644 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:21:11.289026 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:21:11.318347 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:21:11.319708 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Marking volume 30f31fc1-79d9-4f97-8800-85fb096526b0 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:21:11.347135 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to 30f31fc1-79d9-4f97-8800-85fb096526b0. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 21:21:11.347934 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Creating volume glance metadata for volume 30f31fc1-79d9-4f97-8800-85fb096526b0 backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 21:21:11.409940 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ebec62-0998-4128-a125-dce97817e1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f31fc1-79d9-4f97-8800-85fb096526b0', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:11.414913 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5baf875f-a6f5-43e1-955c-92f5d7684345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:11.428169 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Volume volume-30f31fc1-79d9-4f97-8800-85fb096526b0 (30f31fc1-79d9-4f97-8800-85fb096526b0): created successfully Oct 22 21:21:11.432404 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5baf875f-a6f5-43e1-955c-92f5d7684345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:11.439773 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Flow 'volume_create_manager' (7275230a-ac03-4608-acdf-5eabf2bb47fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:21:11.451938 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-44b0fab3-634c-491e-bdd9-7817c69db950 tempest-VolumesExtendTest-2114716238 None] Created volume successfully. Oct 22 21:21:12.604413 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-60d2eee4-72ba-4d13-8ce8-525a4cd554bf tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:12.776046 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-60d2eee4-72ba-4d13-8ce8-525a4cd554bf tempest-VolumesExtendTest-2114716238 None] Extend volume from 1 GB to 2 GB. {{(pid=131630) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:2012}} Oct 22 21:21:12.826831 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-60d2eee4-72ba-4d13-8ce8-525a4cd554bf tempest-VolumesExtendTest-2114716238 None] Extend volume completed successfully. Oct 22 21:21:14.427212 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:21:14.477920 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Flow 'volume_create_manager' (2c0de6a5-edf2-4703-8f9f-168b0869cfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:21:14.495232 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ad347b-0b66-49a3-871a-7d28ceffa361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:14.533161 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ad347b-0b66-49a3-871a-7d28ceffa361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1894205787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=45a78d95-c8c3-4c0a-b4fb-990fa68fb04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0a1cbb3f9c44589e03fcea570a1ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:21:14Z,use_quota=True,user_id='0664c9ee16b843069a8ac4e87acfb65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:14.539460 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7070b262-8026-46be-88e4-82062296215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:14.548375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7070b262-8026-46be-88e4-82062296215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:14.554837 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d52b7d-0d68-4ea9-b6fd-01c836678cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:14.562731 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d52b7d-0d68-4ea9-b6fd-01c836678cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a78d95-c8c3-4c0a-b4fb-990fa68fb04c', 'volume_name': 'volume-45a78d95-c8c3-4c0a-b4fb-990fa68fb04c', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:14.569667 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8f1ab5-f9c2-4b18-9667-8c7dcc4a30b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:14.574307 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8f1ab5-f9c2-4b18-9667-8c7dcc4a30b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:14.583559 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844ef87b-4723-4bed-aafd-d62a42b27340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:14.584966 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Volume 45a78d95-c8c3-4c0a-b4fb-990fa68fb04c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a78d95-c8c3-4c0a-b4fb-990fa68fb04c', 'volume_size': 1} Oct 22 21:21:14.585854 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] creating volume 'volume-45a78d95-c8c3-4c0a-b4fb-990fa68fb04c' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:21:14.587631 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:14.742783 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:21:14.743165 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:21:14.746973 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844ef87b-4723-4bed-aafd-d62a42b27340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a78d95-c8c3-4c0a-b4fb-990fa68fb04c', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:14.753156 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1364d5c1-59ae-41c8-bd91-6cecac6b4adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:21:14.762186 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=57,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=9 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:14.781478 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Volume volume-45a78d95-c8c3-4c0a-b4fb-990fa68fb04c (45a78d95-c8c3-4c0a-b4fb-990fa68fb04c): created successfully Oct 22 21:21:14.785700 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1364d5c1-59ae-41c8-bd91-6cecac6b4adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:21:14.800346 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Flow 'volume_create_manager' (2c0de6a5-edf2-4703-8f9f-168b0869cfe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:21:14.825459 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6b551fc8-b34d-47a2-ab4f-c3b579068c3a tempest-VolumesExtendTest-2114716238 None] Created volume successfully. Oct 22 21:21:15.893516 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0a4ccf60-ed64-40a7-b6fd-ea3c6d989b84 tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:16.282875 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-0a4ccf60-ed64-40a7-b6fd-ea3c6d989b84 tempest-VolumesExtendTest-2114716238 None] Create snapshot completed successfully Oct 22 21:21:16.286249 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=28,cinder:SELECT=59,cinder:INSERT=11,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:17.135265 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6df2f8b6-e52b-451e-b592-b301ac8c230d tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:17.320094 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-6df2f8b6-e52b-451e-b592-b301ac8c230d tempest-VolumesExtendTest-2114716238 None] Extend volume from 1 GB to 2 GB. {{(pid=131630) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:2012}} Oct 22 21:21:17.363532 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-6df2f8b6-e52b-451e-b592-b301ac8c230d tempest-VolumesExtendTest-2114716238 None] Extend volume completed successfully. Oct 22 21:21:18.461905 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-81536709-81b1-4e06-ab7a-d50ac9ee7622 tempest-VolumesExtendTest-2114716238 None] Acquiring lock "cinder-a932f584-20ce-4288-a142-3c8d31114683-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:21:18.478514 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-81536709-81b1-4e06-ab7a-d50ac9ee7622 tempest-VolumesExtendTest-2114716238 None] Lock "cinder-a932f584-20ce-4288-a142-3c8d31114683-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:21:18.480070 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-81536709-81b1-4e06-ab7a-d50ac9ee7622 tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:19.376156 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-81536709-81b1-4e06-ab7a-d50ac9ee7622 tempest-VolumesExtendTest-2114716238 None] Created reservations ['8d937f1a-75cf-42e3-81cc-c651a8f5c7a3', 'd23f2ef6-aa93-4acd-bc92-b9b8ce3dd20e', 'dc6b9ab7-e23c-4c1f-8c9f-1306640406e7', 'edec013d-5f8a-43fd-be46-ce0ba7401c3b'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:21:19.448334 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-81536709-81b1-4e06-ab7a-d50ac9ee7622 tempest-VolumesExtendTest-2114716238 None] Delete snapshot completed successfully. Oct 22 21:21:19.454375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-81536709-81b1-4e06-ab7a-d50ac9ee7622 tempest-VolumesExtendTest-2114716238 None] Lock "cinder-a932f584-20ce-4288-a142-3c8d31114683-delete_snapshot" released by "delete_snapshot" :: held 0.976s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:21:19.643297 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] Acquiring lock "cinder-45a78d95-c8c3-4c0a-b4fb-990fa68fb04c-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:21:19.653093 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] Lock "cinder-45a78d95-c8c3-4c0a-b4fb-990fa68fb04c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:21:19.746814 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:19.852176 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:21:19.852788 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] Volume volume-45a78d95-c8c3-4c0a-b4fb-990fa68fb04c is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:21:19.871581 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] deleting rbd volume volume-45a78d95-c8c3-4c0a-b4fb-990fa68fb04c {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:21:20.206384 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] Created reservations ['76ce8a9f-8901-451c-9fb4-0ce9fca66fa5', '1b429d96-9b4c-44d4-9e18-fc26fe277507', 'ea1441f5-ba24-41b2-99f6-ee5ff9039e9e', '53833201-77d2-4e22-81a0-386dfefc17fc'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:21:20.267940 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:20.361975 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:20.410426 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:21:20.426547 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] Deleted volume successfully. Oct 22 21:21:20.473454 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-800bd95e-ec6d-4439-9f05-28c49df15c62 tempest-VolumesExtendTest-2114716238 None] Lock "cinder-45a78d95-c8c3-4c0a-b4fb-990fa68fb04c-delete_volume" released by "delete_volume" :: held 0.820s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:21:20.897760 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] Acquiring lock "cinder-30f31fc1-79d9-4f97-8800-85fb096526b0-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:21:20.921900 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] Lock "cinder-30f31fc1-79d9-4f97-8800-85fb096526b0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:21:21.005197 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:21.193421 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:21:21.207844 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] deleting rbd volume volume-30f31fc1-79d9-4f97-8800-85fb096526b0 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:21:21.517264 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:21:21.562924 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] deleting parent snapshot volume-30f31fc1-79d9-4f97-8800-85fb096526b0.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:21:22.362918 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] Created reservations ['378431f2-99ed-405a-ae44-08ae8fe97213', 'dc7bad1b-8812-4059-b5d4-8b9cd47583a2', '5c5c5b19-edb1-4ede-9dc1-d312a94ec5be', 'bd2d02c0-145d-4776-a4fb-52682d73c69d'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:21:22.440434 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:22.497203 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:22.543244 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:21:22.549729 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] Deleted volume successfully. Oct 22 21:21:22.573394 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-78bb1704-5da4-49d3-8f4d-4eb708ec1add tempest-VolumesExtendTest-2114716238 None] Lock "cinder-30f31fc1-79d9-4f97-8800-85fb096526b0-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:21:30.510362 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:21:30.511688 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:30.594501 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:21:30.687436 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:21:32.556313 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=43,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:21:47.051822 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=40,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:22:07.044231 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:22:27.048952 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:22:30.514960 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:22:30.516453 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:22:30.558110 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:22:30.594518 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:22:47.041218 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=2,cinder:SELECT=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:23:07.036702 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:23:27.038663 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:23:30.510778 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:23:30.511534 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:23:30.538148 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:23:30.563259 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:23:37.050285 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:23:47.056376 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:07.058941 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:17.066316 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:30.509998 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:24:30.510771 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:24:30.595158 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:24:30.657551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:24:38.245349 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:38.260830 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:24:38.281517 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Flow 'volume_create_manager' (8889f07f-db9c-40cf-946b-b3671cf4a8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:24:38.287832 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d28d84f-8af7-4568-b506-45cb7fc29dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:38.304512 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d28d84f-8af7-4568-b506-45cb7fc29dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-539476845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=07b18d7e-50ab-4ca5-8670-02a2fb9e838d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9820231876a4fa7b74ec9bcece26558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:24:38Z,use_quota=True,user_id='b9a4843607ae4258ae269c7a2a5c20ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:38.309407 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb7e084-3bce-450d-920d-a80f66e1fc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:38.313275 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb7e084-3bce-450d-920d-a80f66e1fc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:38.318105 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f4793c-032a-4a40-a83f-e1ff7a4fada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:38.321896 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f4793c-032a-4a40-a83f-e1ff7a4fada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b18d7e-50ab-4ca5-8670-02a2fb9e838d', 'volume_name': 'volume-07b18d7e-50ab-4ca5-8670-02a2fb9e838d', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:38.326625 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a4ac94-440d-421c-a9bb-eee8128b81af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:38.330373 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a4ac94-440d-421c-a9bb-eee8128b81af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:38.334878 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add7d132-9b4f-4ec0-b5b8-4e76a8595a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:38.335908 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Volume 07b18d7e-50ab-4ca5-8670-02a2fb9e838d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b18d7e-50ab-4ca5-8670-02a2fb9e838d', 'volume_size': 1} Oct 22 21:24:38.336334 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] creating volume 'volume-07b18d7e-50ab-4ca5-8670-02a2fb9e838d' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:24:38.337073 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:24:38.412233 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:24:38.412610 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:24:38.416297 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add7d132-9b4f-4ec0-b5b8-4e76a8595a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b18d7e-50ab-4ca5-8670-02a2fb9e838d', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:38.420702 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003c6cdb-6a38-411d-b7be-c71324649ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:38.432707 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Volume volume-07b18d7e-50ab-4ca5-8670-02a2fb9e838d (07b18d7e-50ab-4ca5-8670-02a2fb9e838d): created successfully Oct 22 21:24:38.436605 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003c6cdb-6a38-411d-b7be-c71324649ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:38.441825 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Flow 'volume_create_manager' (8889f07f-db9c-40cf-946b-b3671cf4a8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:24:38.451704 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9fda393a-7db0-4b62-af11-efdff7f4dccc tempest-VolumesBackupsAdminTest-2102303030 None] Created volume successfully. Oct 22 21:24:39.460529 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8f5f572a-67a2-49d6-a9ec-7d2da94b9418 tempest-VolumesBackupsAdminTest-2102303030 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-22T21:24:39Z,data_timestamp=2022-10-22T21:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-2041225873',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=f6add7cb-b584-4405-a844-6d33f3a1443b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c9820231876a4fa7b74ec9bcece26558',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b9a4843607ae4258ae269c7a2a5c20ed',volume_id=07b18d7e-50ab-4ca5-8670-02a2fb9e838d) Oct 22 21:24:39.461270 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.backup.rpcapi [None req-8f5f572a-67a2-49d6-a9ec-7d2da94b9418 tempest-VolumesBackupsAdminTest-2102303030 None] continue_backup in rpcapi backup_id f6add7cb-b584-4405-a844-6d33f3a1443b {{(pid=131630) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Oct 22 21:24:39.609839 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-8f5f572a-67a2-49d6-a9ec-7d2da94b9418 tempest-VolumesBackupsAdminTest-2102303030 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:24:41.097749 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-8f5f572a-67a2-49d6-a9ec-7d2da94b9418 tempest-VolumesBackupsAdminTest-2102303030 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.487s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:24:41.098904 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8f5f572a-67a2-49d6-a9ec-7d2da94b9418 tempest-VolumesBackupsAdminTest-2102303030 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-07b18d7e-50ab-4ca5-8670-02a2fb9e838d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '07b18d7e-50ab-4ca5-8670-02a2fb9e838d', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:24:41.117177 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8f5f572a-67a2-49d6-a9ec-7d2da94b9418 tempest-VolumesBackupsAdminTest-2102303030 None] Initialize volume connection completed successfully. Oct 22 21:24:42.582953 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8f5f572a-67a2-49d6-a9ec-7d2da94b9418 tempest-VolumesBackupsAdminTest-2102303030 None] Terminate volume connection completed successfully. Oct 22 21:24:42.600400 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8f5f572a-67a2-49d6-a9ec-7d2da94b9418 tempest-VolumesBackupsAdminTest-2102303030 None] Remove volume export completed successfully. Oct 22 21:24:45.311172 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:24:45.341559 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Flow 'volume_create_manager' (f7edd6ff-5726-447c-a6e2-a3fa62cdaa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:24:45.350332 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e65e47-9131-408b-877e-9e46f5593deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:45.385127 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e65e47-9131-408b-877e-9e46f5593deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:24:45Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_f6add7cb-b584-4405-a844-6d33f3a1443b',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3ccb4599-c945-407a-9b40-db1be9a0a743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9820231876a4fa7b74ec9bcece26558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:24:45Z,use_quota=True,user_id='b9a4843607ae4258ae269c7a2a5c20ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:45.391370 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a580ba8-dbc9-4b94-9d88-076e5c17745a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:45.395783 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a580ba8-dbc9-4b94-9d88-076e5c17745a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:45.400942 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da2a914-1379-4dc1-acd9-1c49c96ad7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:45.405038 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da2a914-1379-4dc1-acd9-1c49c96ad7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ccb4599-c945-407a-9b40-db1be9a0a743', 'volume_name': 'volume-3ccb4599-c945-407a-9b40-db1be9a0a743', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:45.409676 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f10064-fec7-4505-991c-762ae40f22ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:45.413574 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f10064-fec7-4505-991c-762ae40f22ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:45.418570 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd669f3-5c7c-4cca-a55d-d9fba57ae099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:45.419678 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Volume 3ccb4599-c945-407a-9b40-db1be9a0a743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ccb4599-c945-407a-9b40-db1be9a0a743', 'volume_size': 1} Oct 22 21:24:45.420098 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] creating volume 'volume-3ccb4599-c945-407a-9b40-db1be9a0a743' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:24:45.421244 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:24:45.504695 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:24:45.505114 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:24:45.508949 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd669f3-5c7c-4cca-a55d-d9fba57ae099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ccb4599-c945-407a-9b40-db1be9a0a743', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:45.513570 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56601c01-d728-4c56-8766-a0f16da455d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:45.524180 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Volume volume-3ccb4599-c945-407a-9b40-db1be9a0a743 (3ccb4599-c945-407a-9b40-db1be9a0a743): created successfully Oct 22 21:24:45.528153 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56601c01-d728-4c56-8766-a0f16da455d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:45.533353 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Flow 'volume_create_manager' (f7edd6ff-5726-447c-a6e2-a3fa62cdaa4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:24:45.543224 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Created volume successfully. Oct 22 21:24:46.398015 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:24:47.277120 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.879s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:24:47.278636 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3ccb4599-c945-407a-9b40-db1be9a0a743', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '3ccb4599-c945-407a-9b40-db1be9a0a743', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:24:47.281874 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=21,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:24:47.306477 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Initialize volume connection completed successfully. Oct 22 21:24:48.762421 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Terminate volume connection completed successfully. Oct 22 21:24:48.783051 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d627f01c-ef75-40d5-8d5e-c6f2254f5d3d tempest-VolumesBackupsAdminTest-2102303030 None] Remove volume export completed successfully. Oct 22 21:24:49.616870 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-70500cf4-c156-4804-bbcf-a36407229725 tempest-VolumesBackupsAdminTest-2102303030 None] Acquiring lock "cinder-3ccb4599-c945-407a-9b40-db1be9a0a743-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:24:49.635277 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-70500cf4-c156-4804-bbcf-a36407229725 tempest-VolumesBackupsAdminTest-2102303030 None] Lock "cinder-3ccb4599-c945-407a-9b40-db1be9a0a743-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:24:49.689335 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-70500cf4-c156-4804-bbcf-a36407229725 tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:24:50.593752 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-70500cf4-c156-4804-bbcf-a36407229725 tempest-VolumesBackupsAdminTest-2102303030 None] Volume volume-3ccb4599-c945-407a-9b40-db1be9a0a743 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:24:50.611016 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-70500cf4-c156-4804-bbcf-a36407229725 tempest-VolumesBackupsAdminTest-2102303030 None] deleting rbd volume volume-3ccb4599-c945-407a-9b40-db1be9a0a743 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:24:50.887819 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-70500cf4-c156-4804-bbcf-a36407229725 tempest-VolumesBackupsAdminTest-2102303030 None] Created reservations ['9f9c11f3-4b40-43ea-bdbe-ea96c0f50419', '49be7f17-3899-41b6-946a-391e99451bbc', 'd9c1250d-7b9b-4cb5-b2d0-7c81841e8e72', 'a5beb3f2-53aa-4fe5-96b5-95a86ce5c051'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:24:50.953551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-70500cf4-c156-4804-bbcf-a36407229725 tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:24:50.992504 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-70500cf4-c156-4804-bbcf-a36407229725 tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:24:51.029605 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-70500cf4-c156-4804-bbcf-a36407229725 tempest-VolumesBackupsAdminTest-2102303030 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:24:51.035639 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-70500cf4-c156-4804-bbcf-a36407229725 tempest-VolumesBackupsAdminTest-2102303030 None] Deleted volume successfully. Oct 22 21:24:51.052332 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-70500cf4-c156-4804-bbcf-a36407229725 tempest-VolumesBackupsAdminTest-2102303030 None] Lock "cinder-3ccb4599-c945-407a-9b40-db1be9a0a743-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:24:53.333880 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:24:53.356376 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Flow 'volume_create_manager' (7c6c8a4c-a770-4b36-a1e0-a12e9e0f516e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:24:53.364693 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d483cce5-7034-4e56-8556-70e1bd36b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:53.382276 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d483cce5-7034-4e56-8556-70e1bd36b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-38055982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4ae27d0a-6a8b-43c3-b798-0a77a71b616c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9820231876a4fa7b74ec9bcece26558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:24:53Z,use_quota=True,user_id='b9a4843607ae4258ae269c7a2a5c20ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:53.390286 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978b80d4-0d66-43aa-a956-07f6d33e96cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:53.394612 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978b80d4-0d66-43aa-a956-07f6d33e96cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:53.399612 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea62006-c0c3-4b8b-9dc1-0cf2c42d3fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:53.403780 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea62006-c0c3-4b8b-9dc1-0cf2c42d3fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae27d0a-6a8b-43c3-b798-0a77a71b616c', 'volume_name': 'volume-4ae27d0a-6a8b-43c3-b798-0a77a71b616c', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:53.408543 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6625be8-cce0-4eb5-b02a-cadc9153ee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:53.412303 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6625be8-cce0-4eb5-b02a-cadc9153ee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:53.417066 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953751b8-d04a-4cff-b267-abaff190bc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:53.418075 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Volume 4ae27d0a-6a8b-43c3-b798-0a77a71b616c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae27d0a-6a8b-43c3-b798-0a77a71b616c', 'volume_size': 1} Oct 22 21:24:53.418477 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] creating volume 'volume-4ae27d0a-6a8b-43c3-b798-0a77a71b616c' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:24:53.419276 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:24:53.484544 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:24:53.484918 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:24:53.488524 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953751b8-d04a-4cff-b267-abaff190bc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae27d0a-6a8b-43c3-b798-0a77a71b616c', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:53.493269 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149d3984-c87a-4b6a-b4df-43958ae583d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:24:53.506956 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Volume volume-4ae27d0a-6a8b-43c3-b798-0a77a71b616c (4ae27d0a-6a8b-43c3-b798-0a77a71b616c): created successfully Oct 22 21:24:53.511234 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149d3984-c87a-4b6a-b4df-43958ae583d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:24:53.516801 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Flow 'volume_create_manager' (7c6c8a4c-a770-4b36-a1e0-a12e9e0f516e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:24:53.527178 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-620688fb-c4ee-4d91-82c7-c51b67440dfb tempest-VolumesBackupsAdminTest-2102303030 None] Created volume successfully. Oct 22 21:24:54.563596 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-dd3ce773-6e1e-43cc-a924-e3560676c29b tempest-VolumesBackupsAdminTest-2102303030 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-22T21:24:54Z,data_timestamp=2022-10-22T21:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-189162790',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=ef7131a7-1317-4b37-b09d-5c1430574c1d,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c9820231876a4fa7b74ec9bcece26558',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b9a4843607ae4258ae269c7a2a5c20ed',volume_id=4ae27d0a-6a8b-43c3-b798-0a77a71b616c) Oct 22 21:24:54.565209 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.backup.rpcapi [None req-dd3ce773-6e1e-43cc-a924-e3560676c29b tempest-VolumesBackupsAdminTest-2102303030 None] continue_backup in rpcapi backup_id ef7131a7-1317-4b37-b09d-5c1430574c1d {{(pid=131630) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Oct 22 21:24:54.656762 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-dd3ce773-6e1e-43cc-a924-e3560676c29b tempest-VolumesBackupsAdminTest-2102303030 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:24:55.440539 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [None req-dd3ce773-6e1e-43cc-a924-e3560676c29b tempest-VolumesBackupsAdminTest-2102303030 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.783s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:24:55.441665 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-dd3ce773-6e1e-43cc-a924-e3560676c29b tempest-VolumesBackupsAdminTest-2102303030 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4ae27d0a-6a8b-43c3-b798-0a77a71b616c', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '4ae27d0a-6a8b-43c3-b798-0a77a71b616c', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:24:55.457917 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-dd3ce773-6e1e-43cc-a924-e3560676c29b tempest-VolumesBackupsAdminTest-2102303030 None] Initialize volume connection completed successfully. Oct 22 21:24:57.256007 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-dd3ce773-6e1e-43cc-a924-e3560676c29b tempest-VolumesBackupsAdminTest-2102303030 None] Terminate volume connection completed successfully. Oct 22 21:24:57.273422 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-dd3ce773-6e1e-43cc-a924-e3560676c29b tempest-VolumesBackupsAdminTest-2102303030 None] Remove volume export completed successfully. Oct 22 21:24:58.920453 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5d5e2d1c-08f8-485b-9b73-36edaa7f3615 tempest-VolumesBackupsAdminTest-2102303030 None] Acquiring lock "cinder-4ae27d0a-6a8b-43c3-b798-0a77a71b616c-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:24:58.932800 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5d5e2d1c-08f8-485b-9b73-36edaa7f3615 tempest-VolumesBackupsAdminTest-2102303030 None] Lock "cinder-4ae27d0a-6a8b-43c3-b798-0a77a71b616c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:24:58.978052 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5d5e2d1c-08f8-485b-9b73-36edaa7f3615 tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:00.119037 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5d5e2d1c-08f8-485b-9b73-36edaa7f3615 tempest-VolumesBackupsAdminTest-2102303030 None] Volume volume-4ae27d0a-6a8b-43c3-b798-0a77a71b616c is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:25:00.133195 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5d5e2d1c-08f8-485b-9b73-36edaa7f3615 tempest-VolumesBackupsAdminTest-2102303030 None] deleting rbd volume volume-4ae27d0a-6a8b-43c3-b798-0a77a71b616c {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:25:00.352689 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-5d5e2d1c-08f8-485b-9b73-36edaa7f3615 tempest-VolumesBackupsAdminTest-2102303030 None] Created reservations ['a57f3d16-a185-47af-8388-3a758dccd8e9', '1c84c7bc-7c34-4815-8dbf-8f9649f88d68', '27a32886-462d-4a46-b1ee-4ad3ec83f935', '1e694fc5-a4af-439e-920c-94db0e35678b'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:25:00.399988 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5d5e2d1c-08f8-485b-9b73-36edaa7f3615 tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:00.424332 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5d5e2d1c-08f8-485b-9b73-36edaa7f3615 tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:00.449911 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-5d5e2d1c-08f8-485b-9b73-36edaa7f3615 tempest-VolumesBackupsAdminTest-2102303030 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:25:00.454407 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5d5e2d1c-08f8-485b-9b73-36edaa7f3615 tempest-VolumesBackupsAdminTest-2102303030 None] Deleted volume successfully. Oct 22 21:25:00.470141 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5d5e2d1c-08f8-485b-9b73-36edaa7f3615 tempest-VolumesBackupsAdminTest-2102303030 None] Lock "cinder-4ae27d0a-6a8b-43c3-b798-0a77a71b616c-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:25:01.142580 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d466104d-7a5b-46c5-a135-416131b911a0 tempest-VolumesBackupsAdminTest-2102303030 None] Acquiring lock "cinder-07b18d7e-50ab-4ca5-8670-02a2fb9e838d-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:25:01.151440 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d466104d-7a5b-46c5-a135-416131b911a0 tempest-VolumesBackupsAdminTest-2102303030 None] Lock "cinder-07b18d7e-50ab-4ca5-8670-02a2fb9e838d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:25:01.188910 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d466104d-7a5b-46c5-a135-416131b911a0 tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:02.219639 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d466104d-7a5b-46c5-a135-416131b911a0 tempest-VolumesBackupsAdminTest-2102303030 None] Volume volume-07b18d7e-50ab-4ca5-8670-02a2fb9e838d is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:25:02.235401 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d466104d-7a5b-46c5-a135-416131b911a0 tempest-VolumesBackupsAdminTest-2102303030 None] deleting rbd volume volume-07b18d7e-50ab-4ca5-8670-02a2fb9e838d {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:25:02.454319 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-d466104d-7a5b-46c5-a135-416131b911a0 tempest-VolumesBackupsAdminTest-2102303030 None] Created reservations ['9d222bdf-6d07-400c-af17-c3f7a7d48889', '39494fc1-177e-4e92-ac96-b14f82a214eb', '54a65f1a-26d9-4891-b8d8-bdea04475775', '30fe1411-8def-4e82-9a1f-17eed508bbad'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:25:02.500522 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=60,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=8 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:02.509880 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d466104d-7a5b-46c5-a135-416131b911a0 tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:02.534150 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d466104d-7a5b-46c5-a135-416131b911a0 tempest-VolumesBackupsAdminTest-2102303030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:02.558987 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-d466104d-7a5b-46c5-a135-416131b911a0 tempest-VolumesBackupsAdminTest-2102303030 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:25:02.563454 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d466104d-7a5b-46c5-a135-416131b911a0 tempest-VolumesBackupsAdminTest-2102303030 None] Deleted volume successfully. Oct 22 21:25:02.579466 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d466104d-7a5b-46c5-a135-416131b911a0 tempest-VolumesBackupsAdminTest-2102303030 None] Lock "cinder-07b18d7e-50ab-4ca5-8670-02a2fb9e838d-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:25:06.800148 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:25:06.830009 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Flow 'volume_create_manager' (3eb83eac-e35b-4146-833d-00d769273fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:06.836170 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d659f28d-3888-4e5d-89fc-8513246eb273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:06.852650 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d659f28d-3888-4e5d-89fc-8513246eb273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1363265580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b4141f18-d22a-4b3c-a136-5687ff1e6557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f32a25318dc4a9191c9363dd3d6df1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:25:07Z,use_quota=True,user_id='06edcac8279a46a4bafae15ecefd7850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:06.857828 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120e7e34-e8fd-4d09-a0e0-e291ed82bfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:06.861735 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120e7e34-e8fd-4d09-a0e0-e291ed82bfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:06.866679 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a33ba97-5667-4d6f-bd6e-47cc0f7177e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:06.870488 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a33ba97-5667-4d6f-bd6e-47cc0f7177e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4141f18-d22a-4b3c-a136-5687ff1e6557', 'volume_name': 'volume-b4141f18-d22a-4b3c-a136-5687ff1e6557', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:06.875202 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6033bf-243a-40f4-a95b-912916fb6f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:06.878867 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6033bf-243a-40f4-a95b-912916fb6f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:06.883228 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a0ee5b-6bff-453f-8bbd-5899df16b09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:06.884289 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Volume b4141f18-d22a-4b3c-a136-5687ff1e6557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4141f18-d22a-4b3c-a136-5687ff1e6557', 'volume_size': 1} Oct 22 21:25:06.884682 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] creating volume 'volume-b4141f18-d22a-4b3c-a136-5687ff1e6557' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:25:06.885467 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:06.941592 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:25:06.941887 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:25:06.945427 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a0ee5b-6bff-453f-8bbd-5899df16b09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4141f18-d22a-4b3c-a136-5687ff1e6557', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:06.949721 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc1a29b-a042-4ece-b648-c8f022f32c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:06.962220 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Volume volume-b4141f18-d22a-4b3c-a136-5687ff1e6557 (b4141f18-d22a-4b3c-a136-5687ff1e6557): created successfully Oct 22 21:25:06.965653 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc1a29b-a042-4ece-b648-c8f022f32c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:06.970869 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Flow 'volume_create_manager' (3eb83eac-e35b-4146-833d-00d769273fba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:06.981721 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-3ce02344-8ac0-4dbd-8d5c-7d306c464a89 tempest-VolumesTransfersV357Test-1990419021 None] Created volume successfully. Oct 22 21:25:08.360544 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7881de8e-0580-48bc-b6ff-5c04ae67b19c tempest-VolumesTransfersV357Test-1409163115 None] Transfer volume completed successfully. Oct 22 21:25:08.732711 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] Acquiring lock "cinder-b4141f18-d22a-4b3c-a136-5687ff1e6557-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:25:08.742545 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] Lock "cinder-b4141f18-d22a-4b3c-a136-5687ff1e6557-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:25:08.772427 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:08.815476 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:25:08.815951 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] Volume volume-b4141f18-d22a-4b3c-a136-5687ff1e6557 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:25:08.820976 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] deleting rbd volume volume-b4141f18-d22a-4b3c-a136-5687ff1e6557 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:25:09.000470 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=64,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:09.010763 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] Created reservations ['fe6ed63a-8395-4723-8a24-4cd115cd1403', '0ee2f005-932c-4af3-9a72-05c134e1fdcd', '9bb5c6e3-4a9e-4873-bd6a-ed7ae5a59619', '8d449608-8b92-48fd-87dc-b1e99dad8a67'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:25:09.057772 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:09.083228 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:09.127372 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:25:09.131857 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] Deleted volume successfully. Oct 22 21:25:09.145491 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-5bb7c49b-48b2-4204-84c2-7ca971a789a2 tempest-VolumesTransfersV357Test-1547627544 None] Lock "cinder-b4141f18-d22a-4b3c-a136-5687ff1e6557-delete_volume" released by "delete_volume" :: held 0.403s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:25:10.152396 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:25:10.170967 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Flow 'volume_create_manager' (72f302a9-34c8-43ac-a658-f8a7b7262a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:10.177016 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f2d968-165f-473c-b99e-84dc07c77dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:10.193678 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f2d968-165f-473c-b99e-84dc07c77dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2138169621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b900ada6-0cbe-4e27-a10f-ea8436ba44c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f32a25318dc4a9191c9363dd3d6df1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:25:10Z,use_quota=True,user_id='06edcac8279a46a4bafae15ecefd7850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:10.198669 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27035ae-36dd-4bce-98a6-6fb1b027bb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:10.202631 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27035ae-36dd-4bce-98a6-6fb1b027bb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:10.207431 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31de1832-e4b9-482b-852a-922859002b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:10.211270 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31de1832-e4b9-482b-852a-922859002b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b900ada6-0cbe-4e27-a10f-ea8436ba44c3', 'volume_name': 'volume-b900ada6-0cbe-4e27-a10f-ea8436ba44c3', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:10.215845 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679ca9cd-148d-4380-b6d7-edc036ecd313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:10.219590 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679ca9cd-148d-4380-b6d7-edc036ecd313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:10.223966 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18e2560-8739-4527-8d60-201308af6b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:10.225361 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Volume b900ada6-0cbe-4e27-a10f-ea8436ba44c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b900ada6-0cbe-4e27-a10f-ea8436ba44c3', 'volume_size': 1} Oct 22 21:25:10.225749 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] creating volume 'volume-b900ada6-0cbe-4e27-a10f-ea8436ba44c3' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:25:10.226496 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:10.295229 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:25:10.295737 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:25:10.299268 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18e2560-8739-4527-8d60-201308af6b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b900ada6-0cbe-4e27-a10f-ea8436ba44c3', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:10.303706 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f433be5b-7e5f-4e6f-a2bb-c3261f7ea1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:10.315049 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Volume volume-b900ada6-0cbe-4e27-a10f-ea8436ba44c3 (b900ada6-0cbe-4e27-a10f-ea8436ba44c3): created successfully Oct 22 21:25:10.318989 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f433be5b-7e5f-4e6f-a2bb-c3261f7ea1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:10.324516 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Flow 'volume_create_manager' (72f302a9-34c8-43ac-a658-f8a7b7262a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:10.334094 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-28880a72-3042-4b7b-b84b-3a59e92f40b1 tempest-VolumesTransfersV357Test-1990419021 None] Created volume successfully. Oct 22 21:25:11.482824 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] Acquiring lock "cinder-b900ada6-0cbe-4e27-a10f-ea8436ba44c3-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:25:11.492730 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] Lock "cinder-b900ada6-0cbe-4e27-a10f-ea8436ba44c3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:25:11.521091 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:11.561055 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:25:11.561390 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] Volume volume-b900ada6-0cbe-4e27-a10f-ea8436ba44c3 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:25:11.568941 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] deleting rbd volume volume-b900ada6-0cbe-4e27-a10f-ea8436ba44c3 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:25:11.776501 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] Created reservations ['f34e35ff-210c-4007-8307-6c2b247a89fb', 'b492cb73-0f59-4c6e-a6ac-23b52381878e', '3dc9a17a-efcb-40de-9cf0-af8c3b83179a', '72fd21b8-be22-4e7f-9679-58ba92f4f663'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:25:11.830195 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:11.857077 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:11.886240 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:25:11.890852 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] Deleted volume successfully. Oct 22 21:25:11.903946 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-241e4519-a29a-4ac4-b56e-be298583c8a3 tempest-VolumesTransfersV357Test-1547627544 None] Lock "cinder-b900ada6-0cbe-4e27-a10f-ea8436ba44c3-delete_volume" released by "delete_volume" :: held 0.411s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:25:15.901480 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:25:15.920130 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Flow 'volume_create_manager' (24f1e2af-6d2e-4022-be98-3f95d4cc99c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:15.926496 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecb24e3-d279-4f7f-b5a1-4c210f79078d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:15.944239 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecb24e3-d279-4f7f-b5a1-4c210f79078d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-413477985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dee7d7c4-4c78-4064-a00d-0a92887122ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52fc559ea2474cf29e36b08503631f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:25:16Z,use_quota=True,user_id='c7f567566a214959ab9b34f9e538d0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:15.949322 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb45b97-c97c-4a14-a0af-7b05c57a39e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:15.953326 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb45b97-c97c-4a14-a0af-7b05c57a39e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:15.958127 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b408acb3-a691-4c04-ad6c-4a06a9f2d848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:16.046761 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b408acb3-a691-4c04-ad6c-4a06a9f2d848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dee7d7c4-4c78-4064-a00d-0a92887122ed', 'volume_name': 'volume-dee7d7c4-4c78-4064-a00d-0a92887122ed', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:16.051444 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6abac7-31cc-4c78-9f3a-270d15e6a8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:16.055222 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6abac7-31cc-4c78-9f3a-270d15e6a8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:16.059657 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52f5d78-bbbe-4a58-b7a6-e77a2eda39c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:16.060757 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Volume dee7d7c4-4c78-4064-a00d-0a92887122ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dee7d7c4-4c78-4064-a00d-0a92887122ed', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 21:25:16.061337 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Cloning dee7d7c4-4c78-4064-a00d-0a92887122ed from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 21:25:16.062092 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:25:16.069936 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:25:16.083381 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 25, 16, 75245)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:25:16.083828 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:25:16.084254 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 21:25:16.088858 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.019s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:25:16.089798 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 21:25:16.096219 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 25, 16, 93575)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:25:16.096637 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:25:16.097051 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 21:25:16.109713 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:16.164978 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] creating snapshot='volume-dee7d7c4-4c78-4064-a00d-0a92887122ed.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:25:17.196080 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-dee7d7c4-4c78-4064-a00d-0a92887122ed.clone_snap' to 'volume-dee7d7c4-4c78-4064-a00d-0a92887122ed' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:25:17.322708 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:25:17.324057 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:25:17.324433 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:25:17.344225 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:25:17.344966 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Marking volume dee7d7c4-4c78-4064-a00d-0a92887122ed as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:25:17.354451 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to dee7d7c4-4c78-4064-a00d-0a92887122ed. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 21:25:17.354914 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Creating volume glance metadata for volume dee7d7c4-4c78-4064-a00d-0a92887122ed backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 21:25:17.409178 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52f5d78-bbbe-4a58-b7a6-e77a2eda39c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee7d7c4-4c78-4064-a00d-0a92887122ed', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:17.413807 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd2a68d-ea1e-4bd5-b945-ece65e07dc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:17.423270 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Volume volume-dee7d7c4-4c78-4064-a00d-0a92887122ed (dee7d7c4-4c78-4064-a00d-0a92887122ed): created successfully Oct 22 21:25:17.427035 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd2a68d-ea1e-4bd5-b945-ece65e07dc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:17.432213 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Flow 'volume_create_manager' (24f1e2af-6d2e-4022-be98-3f95d4cc99c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:17.441257 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-ad113be5-f492-4a14-83b3-650b52dfd354 tempest-VolumesCloneTest-1934578197 None] Created volume successfully. Oct 22 21:25:18.361291 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:25:18.388588 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Flow 'volume_create_manager' (000e50fa-0b42-4fff-bd33-89216f8eb352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:18.394873 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f640264e-6ae7-4599-926c-c97670376b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:18.411139 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f640264e-6ae7-4599-926c-c97670376b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1811330454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2af9e961-13fe-435d-a321-a3441bc1be8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52fc559ea2474cf29e36b08503631f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dee7d7c4-4c78-4064-a00d-0a92887122ed,status='creating',terminated_at=None,updated_at=2022-10-22T21:25:18Z,use_quota=True,user_id='c7f567566a214959ab9b34f9e538d0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:18.416227 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d8b059-e7d6-4ec0-a806-8eac555f20ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:18.420098 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d8b059-e7d6-4ec0-a806-8eac555f20ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:18.424987 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf1a331-063f-4528-bcca-9c2c6de7911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:18.428835 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=59,cinder:UPDATE=27,cinder:INSERT=12,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:18.441021 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf1a331-063f-4528-bcca-9c2c6de7911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2af9e961-13fe-435d-a321-a3441bc1be8c', 'volume_name': 'volume-2af9e961-13fe-435d-a321-a3441bc1be8c', 'volume_size': 1, 'source_volid': 'dee7d7c4-4c78-4064-a00d-0a92887122ed', 'source_volstatus': 'available'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:18.445804 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2088dae9-069d-4f57-a91b-5844db6f867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:18.449491 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2088dae9-069d-4f57-a91b-5844db6f867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:18.454097 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919279fc-f411-4a72-a25f-4fa7e057c03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:18.455137 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Volume 2af9e961-13fe-435d-a321-a3441bc1be8c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2af9e961-13fe-435d-a321-a3441bc1be8c', 'volume_size': 1, 'source_volid': 'dee7d7c4-4c78-4064-a00d-0a92887122ed', 'source_volstatus': 'available'} Oct 22 21:25:18.469584 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:18.532528 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] creating snapshot='volume-2af9e961-13fe-435d-a321-a3441bc1be8c.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:25:19.225855 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] cloning 'volume-dee7d7c4-4c78-4064-a00d-0a92887122ed@volume-2af9e961-13fe-435d-a321-a3441bc1be8c.clone_snap' to 'volume-2af9e961-13fe-435d-a321-a3441bc1be8c' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:25:19.413345 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:25:19.414622 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:25:19.414997 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:25:19.435375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:25:19.435934 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Marking volume 2af9e961-13fe-435d-a321-a3441bc1be8c as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:25:19.446907 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Copying metadata from source volume dee7d7c4-4c78-4064-a00d-0a92887122ed to 2af9e961-13fe-435d-a321-a3441bc1be8c. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:440}} Oct 22 21:25:19.477630 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919279fc-f411-4a72-a25f-4fa7e057c03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af9e961-13fe-435d-a321-a3441bc1be8c', 'volume_size': 1, 'source_volid': 'dee7d7c4-4c78-4064-a00d-0a92887122ed', 'source_volstatus': 'available'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:19.482070 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811bb28f-fc35-467d-9139-0c97933debb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:19.492358 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Volume volume-2af9e961-13fe-435d-a321-a3441bc1be8c (2af9e961-13fe-435d-a321-a3441bc1be8c): created successfully Oct 22 21:25:19.495707 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811bb28f-fc35-467d-9139-0c97933debb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:19.501172 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Flow 'volume_create_manager' (000e50fa-0b42-4fff-bd33-89216f8eb352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:19.514518 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-46166fef-6ac3-44da-9ea9-f16406082957 tempest-VolumesCloneTest-1934578197 None] Created volume successfully. Oct 22 21:25:20.811771 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:25:20.830237 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Flow 'volume_create_manager' (7322a9fd-2544-4d24-b37f-c2306d96a24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:20.836372 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e0cbac-223d-4004-9361-e28c9aa29ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:20.852919 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e0cbac-223d-4004-9361-e28c9aa29ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1846134323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6d83fe02-d9cf-460c-be7e-d65086a0e62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52fc559ea2474cf29e36b08503631f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:25:21Z,use_quota=True,user_id='c7f567566a214959ab9b34f9e538d0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:20.857955 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584a09d6-881c-4938-9949-456092798ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:20.861940 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584a09d6-881c-4938-9949-456092798ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:20.867330 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bd0d61-8616-4378-adc5-38c202c50be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:20.871167 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bd0d61-8616-4378-adc5-38c202c50be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d83fe02-d9cf-460c-be7e-d65086a0e62a', 'volume_name': 'volume-6d83fe02-d9cf-460c-be7e-d65086a0e62a', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:20.876138 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4378988-cebe-40ca-b8b1-9b2fd52292b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:20.879827 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4378988-cebe-40ca-b8b1-9b2fd52292b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:20.884197 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bbbd0b-b465-4f43-a602-67a9a79feeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:20.885227 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Volume 6d83fe02-d9cf-460c-be7e-d65086a0e62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d83fe02-d9cf-460c-be7e-d65086a0e62a', 'volume_size': 1} Oct 22 21:25:20.885611 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] creating volume 'volume-6d83fe02-d9cf-460c-be7e-d65086a0e62a' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:25:20.886396 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:20.944559 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:25:20.944929 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:25:20.948520 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bbbd0b-b465-4f43-a602-67a9a79feeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d83fe02-d9cf-460c-be7e-d65086a0e62a', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:20.953041 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1557ffcd-f75e-4962-8afa-301e4a31656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:20.963582 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Volume volume-6d83fe02-d9cf-460c-be7e-d65086a0e62a (6d83fe02-d9cf-460c-be7e-d65086a0e62a): created successfully Oct 22 21:25:20.967101 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1557ffcd-f75e-4962-8afa-301e4a31656c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:20.972793 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Flow 'volume_create_manager' (7322a9fd-2544-4d24-b37f-c2306d96a24c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:20.982978 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4d202edd-c57a-4837-ac6d-e2d5b7c4093e tempest-VolumesCloneTest-1934578197 None] Created volume successfully. Oct 22 21:25:22.238725 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:25:22.267802 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Flow 'volume_create_manager' (9841daf1-bec9-42da-a739-242b7e9f290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:22.273782 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7850c437-c1d8-465b-819a-b94b0553a29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:22.290180 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7850c437-c1d8-465b-819a-b94b0553a29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-440415216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4cb17c93-9997-4925-9aeb-7727caf10f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52fc559ea2474cf29e36b08503631f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:25:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6d83fe02-d9cf-460c-be7e-d65086a0e62a,status='creating',terminated_at=None,updated_at=2022-10-22T21:25:22Z,use_quota=True,user_id='c7f567566a214959ab9b34f9e538d0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:22.295247 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77acafb-6a3f-4c38-b7f0-015bed491ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:22.299157 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77acafb-6a3f-4c38-b7f0-015bed491ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:22.303921 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3674868-1397-4bfa-9961-a4973e1fe2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:22.319887 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3674868-1397-4bfa-9961-a4973e1fe2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4cb17c93-9997-4925-9aeb-7727caf10f60', 'volume_name': 'volume-4cb17c93-9997-4925-9aeb-7727caf10f60', 'volume_size': 2, 'source_volid': '6d83fe02-d9cf-460c-be7e-d65086a0e62a', 'source_volstatus': 'available'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:22.324488 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bd589b-9318-4b6a-8481-fcff7533a3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:22.328373 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bd589b-9318-4b6a-8481-fcff7533a3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:22.332765 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8250df63-8343-4d55-894b-51463264f175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:22.333776 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Volume 4cb17c93-9997-4925-9aeb-7727caf10f60: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4cb17c93-9997-4925-9aeb-7727caf10f60', 'volume_size': 2, 'source_volid': '6d83fe02-d9cf-460c-be7e-d65086a0e62a', 'source_volstatus': 'available'} Oct 22 21:25:22.345145 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:22.387773 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] creating snapshot='volume-4cb17c93-9997-4925-9aeb-7727caf10f60.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:25:23.277932 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] cloning 'volume-6d83fe02-d9cf-460c-be7e-d65086a0e62a@volume-4cb17c93-9997-4925-9aeb-7727caf10f60.clone_snap' to 'volume-4cb17c93-9997-4925-9aeb-7727caf10f60' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:25:23.367831 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Volume volume-6d83fe02-d9cf-460c-be7e-d65086a0e62a is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:25:23.369229 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:25:23.369613 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:25:23.385260 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] resize volume 'volume-4cb17c93-9997-4925-9aeb-7727caf10f60' from 1 to 2 {{(pid=131630) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:812}} Oct 22 21:25:23.385941 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:23.476291 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:25:23.479813 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8250df63-8343-4d55-894b-51463264f175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb17c93-9997-4925-9aeb-7727caf10f60', 'volume_size': 2, 'source_volid': '6d83fe02-d9cf-460c-be7e-d65086a0e62a', 'source_volstatus': 'available'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:23.484131 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064e9396-4335-4d6b-b591-c5843c4bee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:23.496166 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Volume volume-4cb17c93-9997-4925-9aeb-7727caf10f60 (4cb17c93-9997-4925-9aeb-7727caf10f60): created successfully Oct 22 21:25:23.500204 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064e9396-4335-4d6b-b591-c5843c4bee3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:23.506484 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Flow 'volume_create_manager' (9841daf1-bec9-42da-a739-242b7e9f290f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:23.521488 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-5c8bb47a-77bf-4ee6-bcfe-40ca187b07f3 tempest-VolumesCloneTest-1934578197 None] Created volume successfully. Oct 22 21:25:24.430062 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] Acquiring lock "cinder-4cb17c93-9997-4925-9aeb-7727caf10f60-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:25:24.440118 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] Lock "cinder-4cb17c93-9997-4925-9aeb-7727caf10f60-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:25:24.474953 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:24.531752 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:25:24.538039 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] deleting rbd volume volume-4cb17c93-9997-4925-9aeb-7727caf10f60 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:25:24.725009 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:25:24.743355 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] Volume volume-6d83fe02-d9cf-460c-be7e-d65086a0e62a is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:25:24.744019 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] deleting parent snapshot volume-4cb17c93-9997-4925-9aeb-7727caf10f60.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:25:25.336112 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] Created reservations ['8f117dbc-f6f1-459b-b52f-8a2fa61424c9', '3523d9bc-27e8-4b15-baaa-1a494774c0b5', '5c66aef7-4142-43f1-913c-91691f10721d', 'bc82319d-c9ed-4643-9d8f-f97172c79724'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:25:25.345278 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=24,cinder:SELECT=58,cinder:DELETE=3,cinder:INSERT=15 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:25.386224 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:25.417727 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:25.448075 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:25:25.453426 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] Deleted volume successfully. Oct 22 21:25:25.468357 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-89b98e3f-c3d3-4be7-89a7-69d3c65f935c tempest-VolumesCloneTest-1934578197 None] Lock "cinder-4cb17c93-9997-4925-9aeb-7727caf10f60-delete_volume" released by "delete_volume" :: held 1.028s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:25:25.573000 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] Acquiring lock "cinder-6d83fe02-d9cf-460c-be7e-d65086a0e62a-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:25:25.580857 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] Lock "cinder-6d83fe02-d9cf-460c-be7e-d65086a0e62a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:25:25.615159 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:25.672694 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:25:25.673123 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] Volume volume-6d83fe02-d9cf-460c-be7e-d65086a0e62a is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:25:25.680557 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] deleting rbd volume volume-6d83fe02-d9cf-460c-be7e-d65086a0e62a {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:25:25.878905 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] Created reservations ['33bb15a4-ce17-4180-b17d-95ed9f4c8412', '379619f9-300d-4d51-8807-a31d92bb8bcd', '72bedbbd-b3b9-44c5-8cba-57be017dec06', '6906d50b-0314-4395-b7c9-2fef895707c0'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:25:25.928192 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:25.952040 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:25.978059 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:25:25.983046 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] Deleted volume successfully. Oct 22 21:25:25.998409 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8f3ad94c-62a8-45cd-a759-7ef0d73eebc8 tempest-VolumesCloneTest-1934578197 None] Lock "cinder-6d83fe02-d9cf-460c-be7e-d65086a0e62a-delete_volume" released by "delete_volume" :: held 0.417s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:25:26.715031 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] Acquiring lock "cinder-2af9e961-13fe-435d-a321-a3441bc1be8c-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:25:26.725726 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] Lock "cinder-2af9e961-13fe-435d-a321-a3441bc1be8c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:25:26.757859 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:26.832413 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:25:26.842635 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] deleting rbd volume volume-2af9e961-13fe-435d-a321-a3441bc1be8c {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:25:27.033823 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:25:27.088938 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] deleting parent snapshot volume-2af9e961-13fe-435d-a321-a3441bc1be8c.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:25:27.383309 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] Created reservations ['e9bdb579-1215-4b95-b6c9-f2ba3cf86642', 'ee19d3ca-97e1-46bd-ad5e-bb46f693aa24', 'd9f5deb3-e357-40a3-9432-ef68a34f4451', 'ed955734-3db0-4ba8-838b-7eab165a6bdb'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:25:27.426297 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=31,cinder:SELECT=54,cinder:INSERT=12,cinder:DELETE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:27.440296 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:27.475265 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:27.503386 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:25:27.507771 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] Deleted volume successfully. Oct 22 21:25:27.523237 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-7e447536-cb1d-424e-8cd3-d1305a530cf7 tempest-VolumesCloneTest-1934578197 None] Lock "cinder-2af9e961-13fe-435d-a321-a3441bc1be8c-delete_volume" released by "delete_volume" :: held 0.797s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:25:27.858197 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] Acquiring lock "cinder-dee7d7c4-4c78-4064-a00d-0a92887122ed-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:25:27.883537 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] Lock "cinder-dee7d7c4-4c78-4064-a00d-0a92887122ed-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:25:27.917155 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:27.980212 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:25:27.986703 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] deleting rbd volume volume-dee7d7c4-4c78-4064-a00d-0a92887122ed {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:25:28.157033 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:25:28.188831 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] deleting parent snapshot volume-dee7d7c4-4c78-4064-a00d-0a92887122ed.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:25:28.425132 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] Created reservations ['73ebbe78-909a-487d-aab9-694f75e4829c', '05f30e50-364b-47cb-9477-bf8edafc3c4b', 'a0d54352-003a-4ac7-b370-419eb7752962', '572a78fb-ab56-4cfb-a05b-41a734c1f8b4'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:25:28.483014 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:28.524624 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:28.567217 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:25:28.577354 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] Deleted volume successfully. Oct 22 21:25:28.594282 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-97a3a9fc-662d-4fa8-8a9e-133656e2f318 tempest-VolumesCloneTest-1934578197 None] Lock "cinder-dee7d7c4-4c78-4064-a00d-0a92887122ed-delete_volume" released by "delete_volume" :: held 0.714s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:25:30.514014 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:25:30.514655 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:30.543092 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:30.575127 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:25:30.874382 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:25:30.894532 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Flow 'volume_create_manager' (b698a98c-9008-472b-8617-3c03edf61e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:30.900790 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a190b6-642a-41c9-82c2-2d81e13e8475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:30.917386 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a190b6-642a-41c9-82c2-2d81e13e8475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-368215947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3886f646-49b8-4c8b-90e9-69cb441559c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faef1e3a6a5465aa7ac032469c3f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:25:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:25:31Z,use_quota=True,user_id='4a940e4b988a459ea5bee8cdb41243e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:30.922560 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0bbc7f-9016-4e0f-b64c-0d68ad5a415c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:30.926959 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0bbc7f-9016-4e0f-b64c-0d68ad5a415c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:30.931850 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3061ae-835e-4aa6-a061-2d38960e9702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:30.935745 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3061ae-835e-4aa6-a061-2d38960e9702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3886f646-49b8-4c8b-90e9-69cb441559c7', 'volume_name': 'volume-3886f646-49b8-4c8b-90e9-69cb441559c7', 'volume_size': 2}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:30.940571 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef3dc59-6c99-4d26-8ba5-60212fc77d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:30.944338 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef3dc59-6c99-4d26-8ba5-60212fc77d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:30.948838 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7ebd12-15a8-48af-910d-54711f63b919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:30.949871 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Volume 3886f646-49b8-4c8b-90e9-69cb441559c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3886f646-49b8-4c8b-90e9-69cb441559c7', 'volume_size': 2} Oct 22 21:25:30.950268 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] creating volume 'volume-3886f646-49b8-4c8b-90e9-69cb441559c7' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:25:30.951029 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:31.017034 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:25:31.017353 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:25:31.021084 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7ebd12-15a8-48af-910d-54711f63b919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3886f646-49b8-4c8b-90e9-69cb441559c7', 'volume_size': 2}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:31.025401 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9848921-9733-42d2-a2ef-329ffbb6de93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:25:31.037482 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Volume volume-3886f646-49b8-4c8b-90e9-69cb441559c7 (3886f646-49b8-4c8b-90e9-69cb441559c7): created successfully Oct 22 21:25:31.040945 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9848921-9733-42d2-a2ef-329ffbb6de93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:25:31.046200 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Flow 'volume_create_manager' (b698a98c-9008-472b-8617-3c03edf61e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:25:31.056791 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-98c30b3c-e5f0-4b24-83bc-7a5e56e6978c tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Created volume successfully. Oct 22 21:25:32.085683 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9e4448c5-da18-449d-aa12-b19f8be7e2b4 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:32.441495 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9e4448c5-da18-449d-aa12-b19f8be7e2b4 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Create snapshot completed successfully Oct 22 21:25:33.224112 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8f6e5d93-2c9f-443c-b7a8-e546786bd384 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Acquiring lock "cinder-013ac48a-13d1-4421-b47c-0cd70b9cc42b-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:25:33.240660 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8f6e5d93-2c9f-443c-b7a8-e546786bd384 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Lock "cinder-013ac48a-13d1-4421-b47c-0cd70b9cc42b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:25:33.242101 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8f6e5d93-2c9f-443c-b7a8-e546786bd384 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:33.475098 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-8f6e5d93-2c9f-443c-b7a8-e546786bd384 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Created reservations ['c700d936-537b-430f-aa68-3f4f4fa51e6c', 'c126eba2-6325-4c76-b515-fce7f55a6bb4', 'b0285e87-c08c-487f-9d44-9db2dce72204', 'd0a3400c-efe5-418b-9df4-5ead2b006239'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:25:33.496512 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=55,cinder:UPDATE=34,cinder:DELETE=3,cinder:INSERT=8 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:25:33.513096 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8f6e5d93-2c9f-443c-b7a8-e546786bd384 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Delete snapshot completed successfully. Oct 22 21:25:33.518042 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8f6e5d93-2c9f-443c-b7a8-e546786bd384 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Lock "cinder-013ac48a-13d1-4421-b47c-0cd70b9cc42b-delete_snapshot" released by "delete_snapshot" :: held 0.277s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:25:34.345381 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Acquiring lock "cinder-3886f646-49b8-4c8b-90e9-69cb441559c7-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:25:34.362709 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Lock "cinder-3886f646-49b8-4c8b-90e9-69cb441559c7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:25:34.406981 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:34.458290 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:25:34.458707 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Volume volume-3886f646-49b8-4c8b-90e9-69cb441559c7 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:25:34.469592 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] deleting rbd volume volume-3886f646-49b8-4c8b-90e9-69cb441559c7 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:25:34.692706 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Created reservations ['769b25cd-49fa-4c9b-b5d5-b297098c8b3c', '1660dc6b-6341-4c36-ab41-76885dd5f05f', '5c59e00f-c5e0-49ba-869e-e8fdb21eae8c', '15c4150f-06c2-43ca-93a3-c3cb2e91463c'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:25:34.763003 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:34.795408 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:25:34.836107 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:25:34.841109 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Deleted volume successfully. Oct 22 21:25:34.856012 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e0757b7d-01ff-4de7-9eea-241044b0e131 tempest-VolumesSnapshotNegativeTestJSON-1663611029 None] Lock "cinder-3886f646-49b8-4c8b-90e9-69cb441559c7-delete_volume" released by "delete_volume" :: held 0.493s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:26:07.343791 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=45,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:26:07.344494 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=19,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:26:30.512053 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:26:30.513541 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:26:30.545428 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:26:30.569096 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:26:43.493731 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:26:43.510940 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:26:43.529299 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Flow 'volume_create_manager' (c2f6f9e0-0c22-4d8f-9487-e6e7924d16d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:26:43.535288 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66da67be-f4f5-441f-9d6d-0dfd6f20672f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:26:43.551177 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66da67be-f4f5-441f-9d6d-0dfd6f20672f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1598279749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=59e7c6e3-0443-462a-9aa6-f22804ff91a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435c26b86be44362be1bd042a5cb4c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:26:43Z,use_quota=True,user_id='8e102b243ece4d66bf042337324b04b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:26:43.556303 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96324251-df03-48f7-be93-454c8b27c528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:26:43.560426 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96324251-df03-48f7-be93-454c8b27c528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:26:43.565222 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4efe4a-14e7-48f7-afdd-6bb32a933cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:26:43.569039 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4efe4a-14e7-48f7-afdd-6bb32a933cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59e7c6e3-0443-462a-9aa6-f22804ff91a8', 'volume_name': 'volume-59e7c6e3-0443-462a-9aa6-f22804ff91a8', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:26:43.573602 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a012676a-05e7-42ad-8482-266d343a690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:26:43.577314 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a012676a-05e7-42ad-8482-266d343a690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:26:43.581688 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2097664f-2c95-4649-99b9-b0c47afdb10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:26:43.582693 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Volume 59e7c6e3-0443-462a-9aa6-f22804ff91a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59e7c6e3-0443-462a-9aa6-f22804ff91a8', 'volume_size': 1} Oct 22 21:26:43.583087 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] creating volume 'volume-59e7c6e3-0443-462a-9aa6-f22804ff91a8' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:26:43.583858 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:26:43.653703 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:26:43.654085 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:26:43.657905 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2097664f-2c95-4649-99b9-b0c47afdb10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59e7c6e3-0443-462a-9aa6-f22804ff91a8', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:26:43.662252 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ae315f-f1d8-4855-86d4-0ddb481be6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:26:43.674749 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Volume volume-59e7c6e3-0443-462a-9aa6-f22804ff91a8 (59e7c6e3-0443-462a-9aa6-f22804ff91a8): created successfully Oct 22 21:26:43.680270 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ae315f-f1d8-4855-86d4-0ddb481be6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:26:43.688705 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Flow 'volume_create_manager' (c2f6f9e0-0c22-4d8f-9487-e6e7924d16d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:26:43.701866 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-942086f8-07c3-438a-9221-9ebfebe56a32 tempest-AttachVolumeNegativeTest-80303400 None] Created volume successfully. Oct 22 21:26:44.989813 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-45b2a525-061d-4acb-af60-fcbaa577c028 req-b46b81df-cb50-4f74-9c10-341aaec02fce tempest-AttachVolumeNegativeTest-80303400 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:26:45.729554 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-45b2a525-061d-4acb-af60-fcbaa577c028 req-b46b81df-cb50-4f74-9c10-341aaec02fce tempest-AttachVolumeNegativeTest-80303400 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.739s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:26:45.730316 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-45b2a525-061d-4acb-af60-fcbaa577c028 req-b46b81df-cb50-4f74-9c10-341aaec02fce tempest-AttachVolumeNegativeTest-80303400 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-59e7c6e3-0443-462a-9aa6-f22804ff91a8', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '59e7c6e3-0443-462a-9aa6-f22804ff91a8', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:26:45.756650 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-45b2a525-061d-4acb-af60-fcbaa577c028 req-b46b81df-cb50-4f74-9c10-341aaec02fce tempest-AttachVolumeNegativeTest-80303400 None] Connection info returned from driver {'name': 'volumes/volume-59e7c6e3-0443-462a-9aa6-f22804ff91a8', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '59e7c6e3-0443-462a-9aa6-f22804ff91a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8e22a99e-8c31-4409-af46-d938245de235'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:26:45.807681 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-45b2a525-061d-4acb-af60-fcbaa577c028 req-b46b81df-cb50-4f74-9c10-341aaec02fce tempest-AttachVolumeNegativeTest-80303400 None] attachment_update completed successfully. Oct 22 21:26:57.360440 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=20,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:27:17.359327 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=19,cinder:UPDATE=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:27:30.513933 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:27:30.515597 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:27:30.580180 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:27:30.625964 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:27:37.360444 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:27:57.367210 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:07.379075 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:14.673565 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b req-3fecc19d-517f-4d7c-8938-17bee2260d5a tempest-AttachVolumeNegativeTest-80303400 None] Terminate volume connection completed successfully. Oct 22 21:28:14.674199 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-2473b6f4-074f-4a98-adcb-24ef6d03ae4b req-3fecc19d-517f-4d7c-8938-17bee2260d5a tempest-AttachVolumeNegativeTest-80303400 None] Deleting attachment 8e22a99e-8c31-4409-af46-d938245de235. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:28:27.380252 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:27.381743 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:30.513705 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:28:30.514743 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:28:30.550499 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:28:30.575168 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:28:57.394046 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:28:57.401528 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:29:17.395716 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:29:30.509887 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:29:30.510594 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:29:30.536748 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:29:30.560855 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:29:37.401226 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:29:37.486732 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:29:37.506075 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Flow 'volume_create_manager' (14fa3182-161a-4f6f-a6bc-17e4eabb90fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:29:37.513019 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fc781c-46a9-4d0c-aad4-1614b014fecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:29:37.528941 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fc781c-46a9-4d0c-aad4-1614b014fecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-422659906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=27da303b-f9e4-42d2-b1f6-d01ef39bb876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435c26b86be44362be1bd042a5cb4c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:29:37Z,use_quota=True,user_id='8e102b243ece4d66bf042337324b04b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:29:37.534367 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e609937-1908-434c-ab00-9d8c1c3de5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:29:37.538337 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e609937-1908-434c-ab00-9d8c1c3de5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:29:37.543185 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f6f620-ef4b-48d3-ae28-027490fcf4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:29:37.547270 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f6f620-ef4b-48d3-ae28-027490fcf4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27da303b-f9e4-42d2-b1f6-d01ef39bb876', 'volume_name': 'volume-27da303b-f9e4-42d2-b1f6-d01ef39bb876', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:29:37.551931 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e24a2ea-f882-42b9-966f-db7adb1ef0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:29:37.555634 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e24a2ea-f882-42b9-966f-db7adb1ef0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:29:37.560067 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3fe314-1f1b-48fa-ad7a-795a13eb90ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:29:37.561170 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Volume 27da303b-f9e4-42d2-b1f6-d01ef39bb876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27da303b-f9e4-42d2-b1f6-d01ef39bb876', 'volume_size': 1} Oct 22 21:29:37.561519 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] creating volume 'volume-27da303b-f9e4-42d2-b1f6-d01ef39bb876' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:29:37.562949 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:29:37.627522 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:29:37.627875 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:29:37.631421 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3fe314-1f1b-48fa-ad7a-795a13eb90ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27da303b-f9e4-42d2-b1f6-d01ef39bb876', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:29:37.635712 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e393dcfd-6f90-4d77-8e33-770049dd861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:29:37.652343 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Volume volume-27da303b-f9e4-42d2-b1f6-d01ef39bb876 (27da303b-f9e4-42d2-b1f6-d01ef39bb876): created successfully Oct 22 21:29:37.655986 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e393dcfd-6f90-4d77-8e33-770049dd861d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:29:37.661267 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Flow 'volume_create_manager' (14fa3182-161a-4f6f-a6bc-17e4eabb90fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:29:37.670726 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d7b8430e-e34a-4583-bb8a-3d95dee35a8d tempest-AttachVolumeNegativeTest-80303400 None] Created volume successfully. Oct 22 21:29:39.160324 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e req-d0c0e856-e597-4646-b340-99bcfc40a4ba tempest-AttachVolumeNegativeTest-80303400 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:29:39.912990 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e req-d0c0e856-e597-4646-b340-99bcfc40a4ba tempest-AttachVolumeNegativeTest-80303400 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.752s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:29:39.915998 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e req-d0c0e856-e597-4646-b340-99bcfc40a4ba tempest-AttachVolumeNegativeTest-80303400 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-27da303b-f9e4-42d2-b1f6-d01ef39bb876', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '27da303b-f9e4-42d2-b1f6-d01ef39bb876', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:29:39.944464 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e req-d0c0e856-e597-4646-b340-99bcfc40a4ba tempest-AttachVolumeNegativeTest-80303400 None] Connection info returned from driver {'name': 'volumes/volume-27da303b-f9e4-42d2-b1f6-d01ef39bb876', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '27da303b-f9e4-42d2-b1f6-d01ef39bb876', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bf726161-32d8-4ec7-87cb-cd6b81f6ab8a'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:29:39.999138 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-2643ef04-08b0-45a3-8ec3-fb6a5a33d18e req-d0c0e856-e597-4646-b340-99bcfc40a4ba tempest-AttachVolumeNegativeTest-80303400 None] attachment_update completed successfully. Oct 22 21:29:43.401223 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 req-ae089c4d-c8a2-450a-9c37-991296114f53 tempest-AttachVolumeNegativeTest-80303400 None] Terminate volume connection completed successfully. Oct 22 21:29:43.401883 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-5e56bf0e-c466-4f65-8c01-3dd8533d72a7 req-ae089c4d-c8a2-450a-9c37-991296114f53 tempest-AttachVolumeNegativeTest-80303400 None] Deleting attachment bf726161-32d8-4ec7-87cb-cd6b81f6ab8a. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:29:57.403131 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:29:57.409407 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=26,cinder:UPDATE=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:30:17.412899 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:30:27.419252 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:30:30.506813 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:30:30.508258 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:30:30.539765 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:30:30.566504 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:30:57.412023 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:31:07.415008 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:31:10.778842 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:31:10.797820 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Flow 'volume_create_manager' (a22db599-b3c4-4d97-a47e-84599062c897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:31:10.804183 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f196de90-dcee-43f7-a232-56dd817d8788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:31:10.820152 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f196de90-dcee-43f7-a232-56dd817d8788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1180295950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4a610bf5-5949-4ccb-8b42-27f77570dcf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435c26b86be44362be1bd042a5cb4c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:31:11Z,use_quota=True,user_id='8e102b243ece4d66bf042337324b04b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:31:10.825237 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559f23b2-d2fc-4e5b-a635-424b5163f244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:31:10.829158 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559f23b2-d2fc-4e5b-a635-424b5163f244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:31:10.833834 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a437ed-fc12-4f57-b312-d250554882f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:31:10.837650 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a437ed-fc12-4f57-b312-d250554882f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a610bf5-5949-4ccb-8b42-27f77570dcf0', 'volume_name': 'volume-4a610bf5-5949-4ccb-8b42-27f77570dcf0', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:31:10.842328 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecef6399-bcf8-41ff-aad8-f688579102d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:31:10.846183 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecef6399-bcf8-41ff-aad8-f688579102d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:31:10.850908 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd15705-0cc2-4181-9221-a7d6e0d4b264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:31:10.852036 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Volume 4a610bf5-5949-4ccb-8b42-27f77570dcf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a610bf5-5949-4ccb-8b42-27f77570dcf0', 'volume_size': 1} Oct 22 21:31:10.852428 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] creating volume 'volume-4a610bf5-5949-4ccb-8b42-27f77570dcf0' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:31:10.853062 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:10.912384 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:31:10.912754 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:31:10.916335 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd15705-0cc2-4181-9221-a7d6e0d4b264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a610bf5-5949-4ccb-8b42-27f77570dcf0', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:31:10.920697 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b310cef9-0383-4ef1-9cd9-d83b13d86852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:31:10.932827 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Volume volume-4a610bf5-5949-4ccb-8b42-27f77570dcf0 (4a610bf5-5949-4ccb-8b42-27f77570dcf0): created successfully Oct 22 21:31:10.936254 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b310cef9-0383-4ef1-9cd9-d83b13d86852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:31:10.941362 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Flow 'volume_create_manager' (a22db599-b3c4-4d97-a47e-84599062c897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:31:10.952279 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-bb6ee2ba-f6bb-48da-8aaa-df0539331dde tempest-AttachVolumeNegativeTest-80303400 None] Created volume successfully. Oct 22 21:31:12.288407 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 req-e883031e-6020-49c5-90f2-d20f81756e4c tempest-AttachVolumeNegativeTest-80303400 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:31:13.033614 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 req-e883031e-6020-49c5-90f2-d20f81756e4c tempest-AttachVolumeNegativeTest-80303400 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.745s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:31:13.034456 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 req-e883031e-6020-49c5-90f2-d20f81756e4c tempest-AttachVolumeNegativeTest-80303400 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4a610bf5-5949-4ccb-8b42-27f77570dcf0', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '4a610bf5-5949-4ccb-8b42-27f77570dcf0', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:31:13.062270 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 req-e883031e-6020-49c5-90f2-d20f81756e4c tempest-AttachVolumeNegativeTest-80303400 None] Connection info returned from driver {'name': 'volumes/volume-4a610bf5-5949-4ccb-8b42-27f77570dcf0', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4a610bf5-5949-4ccb-8b42-27f77570dcf0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c2379d4f-3bb0-4884-8bbd-6766cca63925'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:31:13.115972 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-7ce6d0ee-37c0-4cd9-aae1-179cdf702331 req-e883031e-6020-49c5-90f2-d20f81756e4c tempest-AttachVolumeNegativeTest-80303400 None] attachment_update completed successfully. Oct 22 21:31:16.385949 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 req-fa33a19c-9beb-4e2f-95e2-f46cb918405f tempest-AttachVolumeNegativeTest-80303400 None] Terminate volume connection completed successfully. Oct 22 21:31:16.386569 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-a5edaf68-a676-44e3-aa19-a5bcba6e0d58 req-fa33a19c-9beb-4e2f-95e2-f46cb918405f tempest-AttachVolumeNegativeTest-80303400 None] Deleting attachment c2379d4f-3bb0-4884-8bbd-6766cca63925. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:31:21.655079 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] Acquiring lock "cinder-4a610bf5-5949-4ccb-8b42-27f77570dcf0-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:31:21.665338 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] Lock "cinder-4a610bf5-5949-4ccb-8b42-27f77570dcf0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:31:21.701372 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:21.739514 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:31:21.740058 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] Volume volume-4a610bf5-5949-4ccb-8b42-27f77570dcf0 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:31:21.744967 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] deleting rbd volume volume-4a610bf5-5949-4ccb-8b42-27f77570dcf0 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:31:21.937679 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] Created reservations ['aadc44ec-48ac-4b54-91db-e5235915528c', '7f980ffa-3c4b-421f-ae04-187468e8d830', '03176e08-b232-4fc2-af77-bc016665c951', '4494f452-f2ae-44d0-8b24-4c2a43fc3f91'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:31:21.984748 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:22.008578 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:22.036455 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:31:22.041420 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] Deleted volume successfully. Oct 22 21:31:22.056403 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c780ea6c-5646-4492-9431-bb1999005e0e tempest-AttachVolumeNegativeTest-80303400 None] Lock "cinder-4a610bf5-5949-4ccb-8b42-27f77570dcf0-delete_volume" released by "delete_volume" :: held 0.391s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:31:22.891580 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] Acquiring lock "cinder-27da303b-f9e4-42d2-b1f6-d01ef39bb876-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:31:22.900389 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] Lock "cinder-27da303b-f9e4-42d2-b1f6-d01ef39bb876-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:31:22.933212 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:22.972213 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:31:22.972966 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] Volume volume-27da303b-f9e4-42d2-b1f6-d01ef39bb876 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:31:22.979869 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] deleting rbd volume volume-27da303b-f9e4-42d2-b1f6-d01ef39bb876 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:31:23.184556 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] Created reservations ['1b796d77-6073-48aa-acad-e553fca3b6bd', '05c0afd1-dfbf-492a-9be8-18a611b51413', '18074cb1-c701-43b1-b8d7-613a74675a20', '13be536a-f529-48a6-8b42-20e89e2ea3c4'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:31:23.232734 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:23.257115 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:23.283016 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:31:23.287133 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] Deleted volume successfully. Oct 22 21:31:23.301999 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b49e5bd3-fe07-4c44-bbb5-030e973514e2 tempest-AttachVolumeNegativeTest-80303400 None] Lock "cinder-27da303b-f9e4-42d2-b1f6-d01ef39bb876-delete_volume" released by "delete_volume" :: held 0.402s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:31:24.192980 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] Acquiring lock "cinder-59e7c6e3-0443-462a-9aa6-f22804ff91a8-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:31:24.203161 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] Lock "cinder-59e7c6e3-0443-462a-9aa6-f22804ff91a8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:31:24.238689 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:24.276961 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:31:24.277387 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] Volume volume-59e7c6e3-0443-462a-9aa6-f22804ff91a8 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:31:24.283048 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] deleting rbd volume volume-59e7c6e3-0443-462a-9aa6-f22804ff91a8 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:31:24.501021 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] Created reservations ['7fa9ead7-294b-4a0f-adc1-f5ca407a66d7', 'ff65ffe8-6022-4ef8-b848-ec7e6c267966', '467d0d5a-af08-4086-9a0a-ebea97e263b4', 'e6c286b2-7975-4e07-b099-a8fbf6b76add'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:31:24.548888 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:24.574067 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:24.601914 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:31:24.605849 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] Deleted volume successfully. Oct 22 21:31:24.624953 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-26482f25-bed9-492d-947e-72eefcde0e5a tempest-AttachVolumeNegativeTest-80303400 None] Lock "cinder-59e7c6e3-0443-462a-9aa6-f22804ff91a8-delete_volume" released by "delete_volume" :: held 0.422s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:31:30.511778 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:31:30.512494 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:30.540625 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:31:30.567975 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:31:34.609972 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=54,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:31:37.429580 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=60,cinder:DELETE=2,cinder:UPDATE=31,cinder:INSERT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:31:57.427305 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:32:15.086379 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:32:15.103401 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:15.122618 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Flow 'volume_create_manager' (401c682a-6e1f-402c-84ce-ea622a7692a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:15.129171 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08e21d6-30a4-4dd1-9031-6ca512181333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:15.150423 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08e21d6-30a4-4dd1-9031-6ca512181333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-912280876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=af43b043-a2db-473b-910f-e9927af1c0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6b57930e124d8e81de02d51e3d2839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:15Z,use_quota=True,user_id='0209b82c266b4b3d9dd10630f4241d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:15.157126 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6867dc46-eb16-432d-8cfe-699b69ac85cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:15.161031 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6867dc46-eb16-432d-8cfe-699b69ac85cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:15.165938 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50c8443-e0fc-490b-992c-48cb02816e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:15.169807 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50c8443-e0fc-490b-992c-48cb02816e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af43b043-a2db-473b-910f-e9927af1c0ed', 'volume_name': 'volume-af43b043-a2db-473b-910f-e9927af1c0ed', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:15.174465 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be007b2a-5929-4dda-b8af-a6de73ab4b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:15.178163 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be007b2a-5929-4dda-b8af-a6de73ab4b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:15.182553 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ef9776-65a1-41f2-97e1-08c0be4618af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:15.183609 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Volume af43b043-a2db-473b-910f-e9927af1c0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af43b043-a2db-473b-910f-e9927af1c0ed', 'volume_size': 1} Oct 22 21:32:15.184006 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] creating volume 'volume-af43b043-a2db-473b-910f-e9927af1c0ed' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:32:15.184778 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:15.250441 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:15.250733 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:15.254238 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ef9776-65a1-41f2-97e1-08c0be4618af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af43b043-a2db-473b-910f-e9927af1c0ed', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:15.258581 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0368fcb-d31c-481f-80cb-98ba1b7eddab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:15.270415 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Volume volume-af43b043-a2db-473b-910f-e9927af1c0ed (af43b043-a2db-473b-910f-e9927af1c0ed): created successfully Oct 22 21:32:15.273769 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0368fcb-d31c-481f-80cb-98ba1b7eddab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:15.278960 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Flow 'volume_create_manager' (401c682a-6e1f-402c-84ce-ea622a7692a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:15.288815 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c52bc99c-9d6a-472e-b96a-0749be8ef16a tempest-VolumeQuotasNegativeTestJSON-616278480 None] Created volume successfully. Oct 22 21:32:16.892923 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] Acquiring lock "cinder-af43b043-a2db-473b-910f-e9927af1c0ed-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:16.902816 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] Lock "cinder-af43b043-a2db-473b-910f-e9927af1c0ed-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:16.934731 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:16.976491 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:16.976910 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] Volume volume-af43b043-a2db-473b-910f-e9927af1c0ed is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:16.984455 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] deleting rbd volume volume-af43b043-a2db-473b-910f-e9927af1c0ed {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:17.191401 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] Created reservations ['4df5dffc-bcdb-4686-baa0-61e55c4bc846', '4f5855c3-6276-4212-8a94-68cdd7bcbae0', 'a5968a27-1225-45a1-bd1a-960f79d567c8', '80ac5240-c720-4192-b0f4-3e04dc6a4900'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:17.238308 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:17.262903 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:17.288604 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:17.292825 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] Deleted volume successfully. Oct 22 21:32:17.306928 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-35275f70-ce34-47c2-9a3d-7f7af4285fd2 tempest-VolumeQuotasNegativeTestJSON-616278480 None] Lock "cinder-af43b043-a2db-473b-910f-e9927af1c0ed-delete_volume" released by "delete_volume" :: held 0.404s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:24.206741 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:24.225820 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Flow 'volume_create_manager' (efd4d90e-0db3-4b4b-9b41-cca90744c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:24.231954 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98a1130-d3eb-4699-9129-6811ab5c0549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:24.248572 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98a1130-d3eb-4699-9129-6811ab5c0549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1628958735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0674fb93-062b-463f-8353-e9c27b369125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1b964d5cf543bf8a79ac339063d733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:24Z,use_quota=True,user_id='6cb2cf7adda44492ba4a34dc42cabfb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:24.253683 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb45056-a115-4f75-a4e3-797d3162d66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:24.257651 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb45056-a115-4f75-a4e3-797d3162d66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:24.262374 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585315a7-d878-4a9d-8cf8-ceb3e9f225ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:24.266278 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585315a7-d878-4a9d-8cf8-ceb3e9f225ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0674fb93-062b-463f-8353-e9c27b369125', 'volume_name': 'volume-0674fb93-062b-463f-8353-e9c27b369125', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:24.270977 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0521f51d-5661-49e0-951e-05d4b7813d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:24.274674 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0521f51d-5661-49e0-951e-05d4b7813d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:24.279074 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f0b49a-32d6-4ee9-870a-57a83302f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:24.280143 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Volume 0674fb93-062b-463f-8353-e9c27b369125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0674fb93-062b-463f-8353-e9c27b369125', 'volume_size': 1} Oct 22 21:32:24.280532 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] creating volume 'volume-0674fb93-062b-463f-8353-e9c27b369125' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:32:24.281285 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:24.336389 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:24.336767 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:24.340281 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f0b49a-32d6-4ee9-870a-57a83302f27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0674fb93-062b-463f-8353-e9c27b369125', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:24.344811 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339a5e4f-4d1e-45a0-b79f-892a60180fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:24.357728 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Volume volume-0674fb93-062b-463f-8353-e9c27b369125 (0674fb93-062b-463f-8353-e9c27b369125): created successfully Oct 22 21:32:24.361348 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339a5e4f-4d1e-45a0-b79f-892a60180fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:24.366568 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Flow 'volume_create_manager' (efd4d90e-0db3-4b4b-9b41-cca90744c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:24.377418 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-de225b59-d8ad-4559-91a9-d39437a12425 tempest-VolumesListAdminTestJSON-1587220253 None] Created volume successfully. Oct 22 21:32:25.619531 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:25.637879 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Flow 'volume_create_manager' (3c815930-cc02-495b-9afe-e3bbf7714811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:25.644241 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c264aa2d-a90d-4b83-8e7a-c33ecf563023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:25.660638 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c264aa2d-a90d-4b83-8e7a-c33ecf563023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-81112201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa0962fc-9d58-41f9-9f9d-40466fbc2fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1b964d5cf543bf8a79ac339063d733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:26Z,use_quota=True,user_id='6cb2cf7adda44492ba4a34dc42cabfb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:25.665672 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8592e3-713f-40a5-bb42-e48c2cd1b266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:25.669660 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8592e3-713f-40a5-bb42-e48c2cd1b266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:25.674617 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f00ca6f-d8f7-48f4-90d9-dcfd702f370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:25.678350 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f00ca6f-d8f7-48f4-90d9-dcfd702f370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa0962fc-9d58-41f9-9f9d-40466fbc2fae', 'volume_name': 'volume-aa0962fc-9d58-41f9-9f9d-40466fbc2fae', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:25.682981 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99383c01-0da7-4a96-aa60-2904384d6706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:25.686647 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99383c01-0da7-4a96-aa60-2904384d6706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:25.691172 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae32035-249c-47c0-a686-19870213e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:25.692219 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Volume aa0962fc-9d58-41f9-9f9d-40466fbc2fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa0962fc-9d58-41f9-9f9d-40466fbc2fae', 'volume_size': 1} Oct 22 21:32:25.692609 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] creating volume 'volume-aa0962fc-9d58-41f9-9f9d-40466fbc2fae' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:32:25.693244 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:25.759654 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:25.760028 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:25.763577 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae32035-249c-47c0-a686-19870213e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0962fc-9d58-41f9-9f9d-40466fbc2fae', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:25.767969 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e957a743-73cc-44fc-9db9-3d5c05d7b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:25.779610 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Volume volume-aa0962fc-9d58-41f9-9f9d-40466fbc2fae (aa0962fc-9d58-41f9-9f9d-40466fbc2fae): created successfully Oct 22 21:32:25.782993 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e957a743-73cc-44fc-9db9-3d5c05d7b05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:25.788185 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Flow 'volume_create_manager' (3c815930-cc02-495b-9afe-e3bbf7714811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:25.798170 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-0ac6c5b7-2420-4c6e-bcf1-d714ff52a706 tempest-VolumesListAdminTestJSON-1587220253 None] Created volume successfully. Oct 22 21:32:27.031937 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:27.052912 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Flow 'volume_create_manager' (57cdc463-5bc9-43c5-815b-b8beb7eabd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:27.058972 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86496359-d418-4a35-9a7b-8c60f4262be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:27.075106 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86496359-d418-4a35-9a7b-8c60f4262be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1337271234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=38933872-b57c-4b09-89d6-83a9b961d0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1b964d5cf543bf8a79ac339063d733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:27Z,use_quota=True,user_id='6cb2cf7adda44492ba4a34dc42cabfb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:27.080401 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f68ea4-c8b1-4a5b-95d4-0426ce1d2a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:27.084317 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f68ea4-c8b1-4a5b-95d4-0426ce1d2a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:27.089097 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15467b99-69ea-4821-8188-98fa7a5c4bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:27.092977 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15467b99-69ea-4821-8188-98fa7a5c4bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38933872-b57c-4b09-89d6-83a9b961d0d8', 'volume_name': 'volume-38933872-b57c-4b09-89d6-83a9b961d0d8', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:27.098055 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dabe078-180d-407d-b2fb-3ee601731a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:27.101789 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dabe078-180d-407d-b2fb-3ee601731a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:27.106323 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f3eb1d-890b-44aa-afe4-536e461b0e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:27.107279 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Volume 38933872-b57c-4b09-89d6-83a9b961d0d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38933872-b57c-4b09-89d6-83a9b961d0d8', 'volume_size': 1} Oct 22 21:32:27.107718 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] creating volume 'volume-38933872-b57c-4b09-89d6-83a9b961d0d8' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:32:27.108332 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:27.163664 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:27.164039 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:27.167580 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f3eb1d-890b-44aa-afe4-536e461b0e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38933872-b57c-4b09-89d6-83a9b961d0d8', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:27.171895 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5ff031-a086-4c33-8ed1-a8d9c219ddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:27.184799 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Volume volume-38933872-b57c-4b09-89d6-83a9b961d0d8 (38933872-b57c-4b09-89d6-83a9b961d0d8): created successfully Oct 22 21:32:27.188219 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5ff031-a086-4c33-8ed1-a8d9c219ddda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:27.193607 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Flow 'volume_create_manager' (57cdc463-5bc9-43c5-815b-b8beb7eabd04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:27.203196 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9f1b622c-1711-48f2-96be-e7ba164dd081 tempest-VolumesListAdminTestJSON-1587220253 None] Created volume successfully. Oct 22 21:32:28.534900 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:28.553377 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Flow 'volume_create_manager' (8810c1fb-f136-4684-ba2f-54b9854ff493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:28.559545 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d409d7f5-76a4-44e5-9322-9b36555b75e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:28.575655 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d409d7f5-76a4-44e5-9322-9b36555b75e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7dbf3438-96ac-4491-9c12-5781d3dc2711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01996fa433f04abcb9178a9cf3f02676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:28Z,use_quota=True,user_id='17eed50d37c24145885b2017a12febde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:28.580928 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340e56bb-ab82-43f6-b649-80a6c8bfa01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:28.584840 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340e56bb-ab82-43f6-b649-80a6c8bfa01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:28.589642 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c369b9f-cd15-4d2b-885b-103fe0cfff03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:28.593494 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c369b9f-cd15-4d2b-885b-103fe0cfff03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dbf3438-96ac-4491-9c12-5781d3dc2711', 'volume_name': 'volume-7dbf3438-96ac-4491-9c12-5781d3dc2711', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:28.598561 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0332f71-4fde-4b21-bb92-9ff5430127f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:28.602291 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0332f71-4fde-4b21-bb92-9ff5430127f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:28.606710 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df643fc-95c2-406b-a439-ee6326547247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:28.607776 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Volume 7dbf3438-96ac-4491-9c12-5781d3dc2711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dbf3438-96ac-4491-9c12-5781d3dc2711', 'volume_size': 1} Oct 22 21:32:28.608170 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] creating volume 'volume-7dbf3438-96ac-4491-9c12-5781d3dc2711' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:32:28.608804 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:28.663895 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:28.664296 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:28.667947 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df643fc-95c2-406b-a439-ee6326547247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dbf3438-96ac-4491-9c12-5781d3dc2711', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:28.672375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ef5c07-be64-4d8a-bf28-5cc01f8bc53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:28.684922 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Volume volume-7dbf3438-96ac-4491-9c12-5781d3dc2711 (7dbf3438-96ac-4491-9c12-5781d3dc2711): created successfully Oct 22 21:32:28.688318 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ef5c07-be64-4d8a-bf28-5cc01f8bc53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:28.693669 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Flow 'volume_create_manager' (8810c1fb-f136-4684-ba2f-54b9854ff493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:28.703144 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b7a8fcf3-d244-40cf-85b7-9e7f4766af04 tempest-VolumesListAdminTestJSON-976864596 None] Created volume successfully. Oct 22 21:32:29.674951 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] Acquiring lock "cinder-7dbf3438-96ac-4491-9c12-5781d3dc2711-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:29.685395 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] Lock "cinder-7dbf3438-96ac-4491-9c12-5781d3dc2711-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:29.713316 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:29.759829 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:29.760262 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] Volume volume-7dbf3438-96ac-4491-9c12-5781d3dc2711 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:29.765254 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] deleting rbd volume volume-7dbf3438-96ac-4491-9c12-5781d3dc2711 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:29.770147 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] Acquiring lock "cinder-38933872-b57c-4b09-89d6-83a9b961d0d8-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:29.779947 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] Lock "cinder-38933872-b57c-4b09-89d6-83a9b961d0d8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:29.819425 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:29.859264 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:29.859782 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] Volume volume-38933872-b57c-4b09-89d6-83a9b961d0d8 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:29.866510 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] deleting rbd volume volume-38933872-b57c-4b09-89d6-83a9b961d0d8 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:29.974638 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] Created reservations ['c7f775aa-809d-43b5-9805-c4dd029ae117', 'c4e5d943-16c3-4394-a5a7-64e5b7308314', '92ac074d-163d-4c7e-87f2-e61e49cc239c', '703dbc62-9b7c-43ab-8bd8-0f13e2a8b776'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:30.028331 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:30.054993 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:30.081779 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:30.087095 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] Deleted volume successfully. Oct 22 21:32:30.111369 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-03c7bf1a-95b4-440e-9458-3285cb10ddad tempest-VolumesListAdminTestJSON-976864596 None] Lock "cinder-7dbf3438-96ac-4491-9c12-5781d3dc2711-delete_volume" released by "delete_volume" :: held 0.426s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:30.121787 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] Created reservations ['4e4b5090-de1e-4df9-9b26-402f984096d1', '78e7e2ee-b9e4-45dd-9426-45f2dcec13cb', 'a23d5415-b423-46cc-91ac-b3f62c775478', 'a23b197e-5471-49f7-b291-5afa16d40c1f'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:30.137446 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=60,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:32:30.171547 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:30.196001 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:30.220498 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:30.226296 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] Deleted volume successfully. Oct 22 21:32:30.240902 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d5a0e6fe-d98b-4153-ba1d-cda9c7c04232 tempest-VolumesListAdminTestJSON-1587220253 None] Lock "cinder-38933872-b57c-4b09-89d6-83a9b961d0d8-delete_volume" released by "delete_volume" :: held 0.461s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:30.513236 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:32:30.514187 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:30.544594 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:30.572599 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:30.891909 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] Acquiring lock "cinder-aa0962fc-9d58-41f9-9f9d-40466fbc2fae-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:30.902310 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] Lock "cinder-aa0962fc-9d58-41f9-9f9d-40466fbc2fae-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:30.936319 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:30.978511 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:30.978935 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] Volume volume-aa0962fc-9d58-41f9-9f9d-40466fbc2fae is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:30.985500 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] deleting rbd volume volume-aa0962fc-9d58-41f9-9f9d-40466fbc2fae {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:31.171238 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=59,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:32:31.204092 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] Created reservations ['8634b7f7-4372-4ea3-8463-d4cecb41e3b1', '1ba22aa2-56c1-4309-b34a-9697291f1a50', '2d4bd848-70e3-415b-852f-dc43265cca6f', '8084f072-9fde-4465-b58f-6808cddced81'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:31.255331 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:31.281182 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:31.306697 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:31.310748 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] Deleted volume successfully. Oct 22 21:32:31.324439 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e1368066-d7f0-4cee-85cb-4205e32d50aa tempest-VolumesListAdminTestJSON-1587220253 None] Lock "cinder-aa0962fc-9d58-41f9-9f9d-40466fbc2fae-delete_volume" released by "delete_volume" :: held 0.422s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:32.032322 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] Acquiring lock "cinder-0674fb93-062b-463f-8353-e9c27b369125-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:32.041236 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] Lock "cinder-0674fb93-062b-463f-8353-e9c27b369125-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:32.075691 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:32.115083 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:32.115546 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] Volume volume-0674fb93-062b-463f-8353-e9c27b369125 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:32.121008 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] deleting rbd volume volume-0674fb93-062b-463f-8353-e9c27b369125 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:32.322693 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] Created reservations ['917e9e9c-e735-4617-aa88-673547caebd9', '8b7223bc-cb05-44a1-ad13-4f2d077dc105', '11f01e30-027f-4774-b62f-f2c65871a6bf', '74844870-7cea-44b3-8a22-feef6ebd910c'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:32.370835 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:32.396607 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:32.421471 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:32.425845 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] Deleted volume successfully. Oct 22 21:32:32.441517 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-d57e30b0-2f8f-49c1-a2b9-591e8598c3e5 tempest-VolumesListAdminTestJSON-1587220253 None] Lock "cinder-0674fb93-062b-463f-8353-e9c27b369125-delete_volume" released by "delete_volume" :: held 0.400s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:35.551820 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:35.570326 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (85e49358-b56c-4890-919f-2e317f5e051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:35.576752 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d9a1b2-b0f6-442c-87c5-c8fe6a724381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:35.596660 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d9a1b2-b0f6-442c-87c5-c8fe6a724381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1189652404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa86877d-5071-4950-8bc7-0cb9942a4692,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0d5ad991cd864218a838da4f12a30e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:36Z,use_quota=True,user_id='12e28bb29efb41f89280c745abbfe007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:35.604185 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb29a0b-5330-4166-89a4-dff5ac93c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:35.610158 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb29a0b-5330-4166-89a4-dff5ac93c612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:35.617631 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0317cf8-a402-4821-9196-a37defe0a5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:35.621570 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0317cf8-a402-4821-9196-a37defe0a5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa86877d-5071-4950-8bc7-0cb9942a4692', 'volume_name': 'volume-aa86877d-5071-4950-8bc7-0cb9942a4692', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:35.626857 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fc7eea-b0cf-4641-84e4-cf6ca8e21500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:35.632708 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fc7eea-b0cf-4641-84e4-cf6ca8e21500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:35.637105 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a704261-a79e-4fa5-855f-eef174ca830c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:35.638163 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Volume aa86877d-5071-4950-8bc7-0cb9942a4692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa86877d-5071-4950-8bc7-0cb9942a4692', 'volume_size': 1} Oct 22 21:32:35.638551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] creating volume 'volume-aa86877d-5071-4950-8bc7-0cb9942a4692' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:32:35.639330 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:35.698013 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:35.698308 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:35.701877 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a704261-a79e-4fa5-855f-eef174ca830c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa86877d-5071-4950-8bc7-0cb9942a4692', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:35.706171 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a54a0a-383f-4429-8b2a-3d98a5bf8ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:35.718831 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Volume volume-aa86877d-5071-4950-8bc7-0cb9942a4692 (aa86877d-5071-4950-8bc7-0cb9942a4692): created successfully Oct 22 21:32:35.722937 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a54a0a-383f-4429-8b2a-3d98a5bf8ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:35.728778 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (85e49358-b56c-4890-919f-2e317f5e051e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:35.739201 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-2c366ed0-30aa-4f50-a1a4-e34eb24723c7 tempest-VolumesGetTest-973008995 None] Created volume successfully. Oct 22 21:32:37.143686 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:37.162063 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (f51643cc-e333-4ff2-a4e1-b5b32ec27398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:37.168154 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8e26d3-bbf5-4263-aef7-bf804b678da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:37.184533 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8e26d3-bbf5-4263-aef7-bf804b678da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1480473710',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b348e34a-55ef-47ea-a4fe-5754f10f5e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5ad991cd864218a838da4f12a30e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:37Z,use_quota=True,user_id='12e28bb29efb41f89280c745abbfe007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:37.189685 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c188b89-add4-400d-83b5-ff5f080125d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:37.193561 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c188b89-add4-400d-83b5-ff5f080125d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:37.198519 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed317ca7-2961-4517-9077-454f33a4e61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:37.202343 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed317ca7-2961-4517-9077-454f33a4e61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b348e34a-55ef-47ea-a4fe-5754f10f5e02', 'volume_name': 'volume-b348e34a-55ef-47ea-a4fe-5754f10f5e02', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:37.206942 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a897945d-9450-4ea4-9cb2-9a53f2f09285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:37.210679 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a897945d-9450-4ea4-9cb2-9a53f2f09285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:37.215245 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8e3ae9-3b66-4d20-b4c5-d791c424b96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:37.216303 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Volume b348e34a-55ef-47ea-a4fe-5754f10f5e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b348e34a-55ef-47ea-a4fe-5754f10f5e02', 'volume_size': 1} Oct 22 21:32:37.216690 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] creating volume 'volume-b348e34a-55ef-47ea-a4fe-5754f10f5e02' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:32:37.217332 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:37.275715 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:37.276015 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:37.279616 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8e3ae9-3b66-4d20-b4c5-d791c424b96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b348e34a-55ef-47ea-a4fe-5754f10f5e02', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:37.283957 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d09211-e834-4b86-816c-26b4e6fd4f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:37.295858 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Volume volume-b348e34a-55ef-47ea-a4fe-5754f10f5e02 (b348e34a-55ef-47ea-a4fe-5754f10f5e02): created successfully Oct 22 21:32:37.299139 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d09211-e834-4b86-816c-26b4e6fd4f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:37.304257 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (f51643cc-e333-4ff2-a4e1-b5b32ec27398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:37.315135 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-65b9da76-76cc-4737-8d5a-a8b8c52d5091 tempest-VolumesGetTest-973008995 None] Created volume successfully. Oct 22 21:32:38.279418 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] Acquiring lock "cinder-b348e34a-55ef-47ea-a4fe-5754f10f5e02-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:38.290376 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] Lock "cinder-b348e34a-55ef-47ea-a4fe-5754f10f5e02-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:38.322765 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:38.363840 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:38.364186 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] Volume volume-b348e34a-55ef-47ea-a4fe-5754f10f5e02 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:38.369470 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] deleting rbd volume volume-b348e34a-55ef-47ea-a4fe-5754f10f5e02 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:38.575838 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] Created reservations ['8bd85364-2312-488f-a51f-908d1972ec54', '34a1afbb-0101-4ebe-9bc7-28a1b08e8d92', '5ec750c4-2278-45fa-bae3-e97f8fd8943f', 'af7ae512-345e-436a-91c1-5b3536922b21'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:38.622333 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:38.647557 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:38.673584 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:38.677939 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] Deleted volume successfully. Oct 22 21:32:38.692467 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-a7efa1a2-b20e-4461-8da8-190d0066f903 tempest-VolumesGetTest-973008995 None] Lock "cinder-b348e34a-55ef-47ea-a4fe-5754f10f5e02-delete_volume" released by "delete_volume" :: held 0.402s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:39.431598 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] Acquiring lock "cinder-aa86877d-5071-4950-8bc7-0cb9942a4692-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:39.440730 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] Lock "cinder-aa86877d-5071-4950-8bc7-0cb9942a4692-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:39.499399 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:39.537136 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:39.537482 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] Volume volume-aa86877d-5071-4950-8bc7-0cb9942a4692 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:39.543438 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] deleting rbd volume volume-aa86877d-5071-4950-8bc7-0cb9942a4692 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:39.740353 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=32,cinder:SELECT=57,cinder:INSERT=6,cinder:DELETE=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:32:39.766253 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] Created reservations ['8c5ec757-7c78-4df7-a625-72ad7dd2186d', '4eb956ea-93b8-4acc-a414-3523c05c8baf', 'a1bdd3b3-1e6d-4c5f-ae92-9c19145fefda', 'a419d251-9574-4d1e-b8ca-e5e9147bd009'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:39.813394 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:INSERT=10,cinder:SELECT=50,cinder:UPDATE=40 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:32:39.820500 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:39.846680 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:39.874219 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:39.879484 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] Deleted volume successfully. Oct 22 21:32:39.894189 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-63e0a8aa-b19d-47a0-99f8-89ed748d304c tempest-VolumesGetTest-973008995 None] Lock "cinder-aa86877d-5071-4950-8bc7-0cb9942a4692-delete_volume" released by "delete_volume" :: held 0.453s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:40.855088 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:40.873396 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (d623b189-4ad9-4326-a558-dd246ef9725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:40.879467 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f4cc0c-7f82-4f29-a8a2-8c3da8e9310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:40.895501 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f4cc0c-7f82-4f29-a8a2-8c3da8e9310c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1961109176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=babfaa78-0e5e-4a97-96c7-2bb98c90d526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5ad991cd864218a838da4f12a30e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:41Z,use_quota=True,user_id='12e28bb29efb41f89280c745abbfe007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:40.900568 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f60a865-2314-4133-97b1-103d76c96ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:40.904724 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f60a865-2314-4133-97b1-103d76c96ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:40.909492 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de89925-456e-4fd7-9aeb-35a0c0e8798c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:40.913329 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de89925-456e-4fd7-9aeb-35a0c0e8798c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babfaa78-0e5e-4a97-96c7-2bb98c90d526', 'volume_name': 'volume-babfaa78-0e5e-4a97-96c7-2bb98c90d526', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:40.917963 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76119c0-62ba-4714-9d1a-7986829713b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:40.921785 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76119c0-62ba-4714-9d1a-7986829713b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:40.926205 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c23eb04-9df0-40cd-a8e2-c8f85fc8397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:40.927225 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Volume babfaa78-0e5e-4a97-96c7-2bb98c90d526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babfaa78-0e5e-4a97-96c7-2bb98c90d526', 'volume_size': 1} Oct 22 21:32:40.927635 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] creating volume 'volume-babfaa78-0e5e-4a97-96c7-2bb98c90d526' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:32:40.928393 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:40.987522 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:40.987903 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:40.991525 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c23eb04-9df0-40cd-a8e2-c8f85fc8397d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babfaa78-0e5e-4a97-96c7-2bb98c90d526', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:40.995963 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444043ab-f3a7-44ee-93dc-b5f6fdcc9eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:41.008122 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Volume volume-babfaa78-0e5e-4a97-96c7-2bb98c90d526 (babfaa78-0e5e-4a97-96c7-2bb98c90d526): created successfully Oct 22 21:32:41.011582 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444043ab-f3a7-44ee-93dc-b5f6fdcc9eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:41.017208 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (d623b189-4ad9-4326-a558-dd246ef9725c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:41.026924 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-fff6d404-3f01-4a3d-89ab-def90ff2ceb3 tempest-VolumesGetTest-973008995 None] Created volume successfully. Oct 22 21:32:42.248636 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:42.275701 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (cea1e5b2-496f-4138-b358-49b60c647bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:42.282050 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4c0b6c-8ec7-4912-a108-4ea77e670d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:42.298632 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4c0b6c-8ec7-4912-a108-4ea77e670d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-651065504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=246a98da-8f09-461d-89b6-9060c755db99,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0d5ad991cd864218a838da4f12a30e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=babfaa78-0e5e-4a97-96c7-2bb98c90d526,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:42Z,use_quota=True,user_id='12e28bb29efb41f89280c745abbfe007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:42.303908 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b568aa10-c1e2-485c-8391-9c687060e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:42.307861 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b568aa10-c1e2-485c-8391-9c687060e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:42.313188 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a126c8b-693c-4c8d-ac20-11b773d7c75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:42.328590 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a126c8b-693c-4c8d-ac20-11b773d7c75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '246a98da-8f09-461d-89b6-9060c755db99', 'volume_name': 'volume-246a98da-8f09-461d-89b6-9060c755db99', 'volume_size': 1, 'source_volid': 'babfaa78-0e5e-4a97-96c7-2bb98c90d526', 'source_volstatus': 'available'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:42.333317 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e2ffb7-87da-490e-938e-87cb8121df76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:42.337097 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e2ffb7-87da-490e-938e-87cb8121df76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:42.341631 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc072b7-ecc7-46cc-a81d-07bbb68bf81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:42.342712 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Volume 246a98da-8f09-461d-89b6-9060c755db99: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-246a98da-8f09-461d-89b6-9060c755db99', 'volume_size': 1, 'source_volid': 'babfaa78-0e5e-4a97-96c7-2bb98c90d526', 'source_volstatus': 'available'} Oct 22 21:32:42.354411 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:42.394692 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] creating snapshot='volume-246a98da-8f09-461d-89b6-9060c755db99.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:32:43.067610 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] cloning 'volume-babfaa78-0e5e-4a97-96c7-2bb98c90d526@volume-246a98da-8f09-461d-89b6-9060c755db99.clone_snap' to 'volume-246a98da-8f09-461d-89b6-9060c755db99' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:32:43.158730 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Volume volume-babfaa78-0e5e-4a97-96c7-2bb98c90d526 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:43.160118 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:43.160500 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:43.180238 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:32:43.183899 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc072b7-ecc7-46cc-a81d-07bbb68bf81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-246a98da-8f09-461d-89b6-9060c755db99', 'volume_size': 1, 'source_volid': 'babfaa78-0e5e-4a97-96c7-2bb98c90d526', 'source_volstatus': 'available'}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:43.188533 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fb5bc4-ce5d-4122-8a05-5a15128677b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:43.200429 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Volume volume-246a98da-8f09-461d-89b6-9060c755db99 (246a98da-8f09-461d-89b6-9060c755db99): created successfully Oct 22 21:32:43.204792 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fb5bc4-ce5d-4122-8a05-5a15128677b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:43.210113 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (cea1e5b2-496f-4138-b358-49b60c647bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:43.225697 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c7b4cda4-837a-42b8-9bc2-fd08302faf26 tempest-VolumesGetTest-973008995 None] Created volume successfully. Oct 22 21:32:43.817324 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:43.837057 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (b53d9af0-3128-4d40-a086-20b4373997dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:43.843382 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36c576f-2276-46c6-b9d2-9cb78a7b949d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:43.862667 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36c576f-2276-46c6-b9d2-9cb78a7b949d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1756481300',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=152c7c55-c303-4390-b0d4-cb6d2d038bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5ad991cd864218a838da4f12a30e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:44Z,use_quota=True,user_id='12e28bb29efb41f89280c745abbfe007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:43.867892 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82e51ef-e91b-4fdf-ba00-a0f43aa3ae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:43.871791 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82e51ef-e91b-4fdf-ba00-a0f43aa3ae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:43.876906 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da90090e-0ab9-40e0-bf16-49cab18516e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:43.880675 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da90090e-0ab9-40e0-bf16-49cab18516e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152c7c55-c303-4390-b0d4-cb6d2d038bd5', 'volume_name': 'volume-152c7c55-c303-4390-b0d4-cb6d2d038bd5', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:43.885286 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04155154-be61-4ac6-b189-ba0570b26953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:43.889457 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04155154-be61-4ac6-b189-ba0570b26953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:43.894631 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a073dd2-4444-4908-959e-8eff50b4fd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:43.895741 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Volume 152c7c55-c303-4390-b0d4-cb6d2d038bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152c7c55-c303-4390-b0d4-cb6d2d038bd5', 'volume_size': 1} Oct 22 21:32:43.896134 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] creating volume 'volume-152c7c55-c303-4390-b0d4-cb6d2d038bd5' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:32:43.896778 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:43.954881 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:43.955254 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:43.958833 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a073dd2-4444-4908-959e-8eff50b4fd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152c7c55-c303-4390-b0d4-cb6d2d038bd5', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:43.963227 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6a4fde-ceee-41c7-b555-d852febccd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:43.974747 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Volume volume-152c7c55-c303-4390-b0d4-cb6d2d038bd5 (152c7c55-c303-4390-b0d4-cb6d2d038bd5): created successfully Oct 22 21:32:43.978363 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6a4fde-ceee-41c7-b555-d852febccd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:43.983925 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (b53d9af0-3128-4d40-a086-20b4373997dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:43.994025 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-869dc33a-f7d2-4439-a683-e579a8e5ca0e tempest-VolumesGetTest-973008995 None] Created volume successfully. Oct 22 21:32:44.957152 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] Acquiring lock "cinder-152c7c55-c303-4390-b0d4-cb6d2d038bd5-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:44.966292 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] Lock "cinder-152c7c55-c303-4390-b0d4-cb6d2d038bd5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:45.002770 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:45.042729 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:45.043073 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] Volume volume-152c7c55-c303-4390-b0d4-cb6d2d038bd5 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:45.049558 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] deleting rbd volume volume-152c7c55-c303-4390-b0d4-cb6d2d038bd5 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:45.262310 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] Created reservations ['c1e44f1a-78a1-4f4d-833f-7256035dfc01', 'ab66081d-65a0-44fb-955d-ee126063afdf', '8c056663-caf7-48e5-b9b9-d85a1a9280dd', '8f9a6be2-952d-4545-a964-12cf7f5769a0'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:45.313642 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:45.338392 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:45.363371 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:45.367490 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] Deleted volume successfully. Oct 22 21:32:45.382254 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-8ebdb75a-e8ef-47ea-a896-d63ce3d379e1 tempest-VolumesGetTest-973008995 None] Lock "cinder-152c7c55-c303-4390-b0d4-cb6d2d038bd5-delete_volume" released by "delete_volume" :: held 0.416s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:46.107697 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] Acquiring lock "cinder-246a98da-8f09-461d-89b6-9060c755db99-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:46.117273 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] Lock "cinder-246a98da-8f09-461d-89b6-9060c755db99-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:46.153050 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:46.203717 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:46.212039 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] deleting rbd volume volume-246a98da-8f09-461d-89b6-9060c755db99 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:46.396705 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:32:46.415633 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] Volume volume-babfaa78-0e5e-4a97-96c7-2bb98c90d526 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:46.416152 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] deleting parent snapshot volume-246a98da-8f09-461d-89b6-9060c755db99.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:32:46.896501 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] Created reservations ['add7dd6c-eccb-4a0e-8b6d-ad7d4625ae13', 'd5b7af94-6e80-49d0-a481-ed6fd84abc55', 'f7195ef8-6478-40f9-9ef1-25690aa267e0', '3ddbec13-16cb-45e9-961a-9ae92add66fc'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:46.942433 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:46.966670 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:46.991727 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:46.996176 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] Deleted volume successfully. Oct 22 21:32:47.010958 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-92354876-5a5c-49f0-9c5c-9274df6872dc tempest-VolumesGetTest-973008995 None] Lock "cinder-246a98da-8f09-461d-89b6-9060c755db99-delete_volume" released by "delete_volume" :: held 0.894s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:47.693560 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:47.711847 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (5f207d60-7868-47d3-b06a-a04cccc1b024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:47.717862 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce4ac27-d756-41ae-a552-c76d80e37421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:47.733917 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce4ac27-d756-41ae-a552-c76d80e37421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-149170842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a859b07e-4aba-4d8d-983d-ee7a16f6bad9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0d5ad991cd864218a838da4f12a30e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:48Z,use_quota=True,user_id='12e28bb29efb41f89280c745abbfe007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:47.739022 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed74c88-9ad1-4a08-aeef-b7bc14227afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:47.742785 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed74c88-9ad1-4a08-aeef-b7bc14227afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:47.747565 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39faae2a-4aa5-443d-b1bc-36524f5dfaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:47.830251 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39faae2a-4aa5-443d-b1bc-36524f5dfaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a859b07e-4aba-4d8d-983d-ee7a16f6bad9', 'volume_name': 'volume-a859b07e-4aba-4d8d-983d-ee7a16f6bad9', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:47.834918 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95f3f24-953e-45e6-ac8e-28d223a6f62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:47.838624 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95f3f24-953e-45e6-ac8e-28d223a6f62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:47.843060 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa57c7e3-45c3-4753-8334-d8b3876a8ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:47.844236 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Volume a859b07e-4aba-4d8d-983d-ee7a16f6bad9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a859b07e-4aba-4d8d-983d-ee7a16f6bad9', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 21:32:47.844798 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Cloning a859b07e-4aba-4d8d-983d-ee7a16f6bad9 from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 21:32:47.845545 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:47.870809 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:47.883199 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 32, 47, 875145)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:32:47.883646 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:32:47.884040 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 21:32:47.888396 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:47.889340 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 21:32:47.895573 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 21, 32, 47, 893056)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 21:32:47.895990 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 21:32:47.896375 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 21:32:47.908203 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:47.962365 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] creating snapshot='volume-a859b07e-4aba-4d8d-983d-ee7a16f6bad9.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 21:32:48.876547 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-a859b07e-4aba-4d8d-983d-ee7a16f6bad9.clone_snap' to 'volume-a859b07e-4aba-4d8d-983d-ee7a16f6bad9' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 21:32:49.006418 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:49.007726 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:49.008100 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:49.027435 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 21:32:49.028190 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Marking volume a859b07e-4aba-4d8d-983d-ee7a16f6bad9 as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 21:32:49.038348 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to a859b07e-4aba-4d8d-983d-ee7a16f6bad9. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 21:32:49.038757 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Creating volume glance metadata for volume a859b07e-4aba-4d8d-983d-ee7a16f6bad9 backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 21:32:49.090633 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa57c7e3-45c3-4753-8334-d8b3876a8ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a859b07e-4aba-4d8d-983d-ee7a16f6bad9', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:49.094968 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20d2f84-7380-4781-ae83-420933507609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:49.105808 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Volume volume-a859b07e-4aba-4d8d-983d-ee7a16f6bad9 (a859b07e-4aba-4d8d-983d-ee7a16f6bad9): created successfully Oct 22 21:32:49.109232 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20d2f84-7380-4781-ae83-420933507609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:49.114606 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (5f207d60-7868-47d3-b06a-a04cccc1b024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:49.123925 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-b672fc0d-b36b-45be-ba8a-a6daba3b1138 tempest-VolumesGetTest-973008995 None] Created volume successfully. Oct 22 21:32:50.318448 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=27,cinder:SELECT=63,cinder:DELETE=4,cinder:INSERT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:32:50.327226 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:32:50.345213 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (e803c0f9-2c30-4d6a-8443-7503462b4a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:50.351681 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c41c903-4622-4984-b382-a1965ae67a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:50.367869 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c41c903-4622-4984-b382-a1965ae67a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:32:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1066318898',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e77ceeef-6f62-4f65-8681-4582b6efa780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5ad991cd864218a838da4f12a30e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:32:50Z,use_quota=True,user_id='12e28bb29efb41f89280c745abbfe007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:50.372863 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ac22da-dc98-4cc6-8ca5-74cb9300c1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:50.376700 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ac22da-dc98-4cc6-8ca5-74cb9300c1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:50.381531 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27db5c37-0272-4f71-ba98-13574dde37de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:50.385316 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27db5c37-0272-4f71-ba98-13574dde37de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77ceeef-6f62-4f65-8681-4582b6efa780', 'volume_name': 'volume-e77ceeef-6f62-4f65-8681-4582b6efa780', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:50.389919 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec13ab38-50c8-419d-81bc-e9d3c559bb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:50.393640 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec13ab38-50c8-419d-81bc-e9d3c559bb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:50.398039 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b37567b-8b73-4953-a5bc-4b0100173c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:50.399054 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Volume e77ceeef-6f62-4f65-8681-4582b6efa780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77ceeef-6f62-4f65-8681-4582b6efa780', 'volume_size': 1} Oct 22 21:32:50.399497 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] creating volume 'volume-e77ceeef-6f62-4f65-8681-4582b6efa780' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:32:50.400213 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:50.460475 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:32:50.460769 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:32:50.464678 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b37567b-8b73-4953-a5bc-4b0100173c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77ceeef-6f62-4f65-8681-4582b6efa780', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:50.469069 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102de273-9b32-4b70-8e7a-266408830afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:32:50.481584 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Volume volume-e77ceeef-6f62-4f65-8681-4582b6efa780 (e77ceeef-6f62-4f65-8681-4582b6efa780): created successfully Oct 22 21:32:50.485113 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102de273-9b32-4b70-8e7a-266408830afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:32:50.490354 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Flow 'volume_create_manager' (e803c0f9-2c30-4d6a-8443-7503462b4a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:32:50.500687 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-79d1acf9-4adb-4e6d-b009-f3a2f4688565 tempest-VolumesGetTest-973008995 None] Created volume successfully. Oct 22 21:32:50.503955 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=58,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=14 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:32:51.466065 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] Acquiring lock "cinder-e77ceeef-6f62-4f65-8681-4582b6efa780-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:51.475490 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] Lock "cinder-e77ceeef-6f62-4f65-8681-4582b6efa780-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:51.510316 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:51.552862 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:51.553207 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] Volume volume-e77ceeef-6f62-4f65-8681-4582b6efa780 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:51.560140 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] deleting rbd volume volume-e77ceeef-6f62-4f65-8681-4582b6efa780 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:51.779257 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] Created reservations ['5c5b80c9-2a25-4531-9f17-ac66d6c9a98c', '220eee90-123e-4b5c-a760-df2c460625ea', 'c4930cf4-7a9c-4505-ae7e-e885ca935efc', '3609cb61-971c-4272-bce9-87ea1e07fd08'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:51.831180 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:51.856309 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:51.880790 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:51.884951 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] Deleted volume successfully. Oct 22 21:32:51.899369 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4e83069d-9c13-47a3-b728-94a3251bc441 tempest-VolumesGetTest-973008995 None] Lock "cinder-e77ceeef-6f62-4f65-8681-4582b6efa780-delete_volume" released by "delete_volume" :: held 0.424s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:52.614235 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] Acquiring lock "cinder-a859b07e-4aba-4d8d-983d-ee7a16f6bad9-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:52.622488 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] Lock "cinder-a859b07e-4aba-4d8d-983d-ee7a16f6bad9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:52.658976 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:52.718202 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:52.725224 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] deleting rbd volume volume-a859b07e-4aba-4d8d-983d-ee7a16f6bad9 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:52.890824 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 21:32:52.925295 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] deleting parent snapshot volume-a859b07e-4aba-4d8d-983d-ee7a16f6bad9.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 21:32:53.053638 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] Created reservations ['7df72206-b41b-4b96-a4bb-86945ae53a73', 'a27b5713-7215-489d-b041-2bd6a6933502', '56df2535-5593-4add-b8eb-bac63c87fafc', '9902431c-7b8f-453b-8053-c784e24085a5'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:53.102030 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:53.125896 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:53.150217 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:53.154017 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] Deleted volume successfully. Oct 22 21:32:53.169372 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c4169b67-c6b2-40ce-b0cd-c307006860f6 tempest-VolumesGetTest-973008995 None] Lock "cinder-a859b07e-4aba-4d8d-983d-ee7a16f6bad9-delete_volume" released by "delete_volume" :: held 0.547s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:32:53.760178 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] Acquiring lock "cinder-babfaa78-0e5e-4a97-96c7-2bb98c90d526-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:32:53.769821 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] Lock "cinder-babfaa78-0e5e-4a97-96c7-2bb98c90d526-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:32:53.801912 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:53.842827 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:32:53.843260 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] Volume volume-babfaa78-0e5e-4a97-96c7-2bb98c90d526 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:32:53.849952 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] deleting rbd volume volume-babfaa78-0e5e-4a97-96c7-2bb98c90d526 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:32:54.070083 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] Created reservations ['9b2faf25-6d70-4b2d-9981-0af05449f478', 'f94e2f58-60bc-4f38-bf09-51f56170cf17', '5a532aed-9e5f-4a98-bd4c-e7f823f16e4d', '40c53eac-a8d4-442e-b6fa-44c6a482973f'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:32:54.114964 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:54.140554 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:32:54.165474 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:32:54.169437 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] Deleted volume successfully. Oct 22 21:32:54.183243 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-ee0d9270-f673-4035-b074-472775587b4d tempest-VolumesGetTest-973008995 None] Lock "cinder-babfaa78-0e5e-4a97-96c7-2bb98c90d526-delete_volume" released by "delete_volume" :: held 0.413s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:33:27.449158 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=38,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:33:27.454226 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=30,cinder:DELETE=2,cinder:SELECT=44,cinder:INSERT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:33:30.518359 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:33:30.519207 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:33:30.550267 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:33:30.574724 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:33:47.462738 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:07.465634 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:17.477743 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:30.520044 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:34:30.521148 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:34:30.554586 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:34:30.583673 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:34:47.459062 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:34:57.461072 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:17.475869 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:27.476302 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:30.521090 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:35:30.522548 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:35:30.562505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:35:30.630816 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:35:47.473852 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:35:57.471664 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:36:17.480655 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:36:30.520163 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:36:30.521214 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:36:30.558964 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:36:30.582359 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:36:37.468064 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:36:37.469687 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:37:17.466437 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:37:17.469073 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:37:30.518175 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:37:30.519975 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:37:30.555058 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:37:30.581115 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:37:47.474828 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:37:47.486106 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:07.484602 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:27.482922 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:38:30.518146 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:38:30.519679 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:38:30.572127 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:38:30.612251 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:38:47.477157 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:39:07.475877 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:39:07.479492 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:39:30.518172 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:39:30.519209 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:39:30.546964 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:39:30.570720 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:39:37.489799 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:39:47.481948 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:40:07.487498 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:40:17.501586 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:40:30.515665 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:40:30.516341 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:40:30.541346 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:40:30.565338 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:40:37.489171 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:40:47.497910 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:41:17.487799 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:41:27.488072 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:41:30.520469 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:41:30.521369 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:41:30.549722 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:41:30.573813 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:41:57.493426 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:42:07.479076 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:42:30.518682 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:42:30.519702 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:42:30.550868 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:42:30.577437 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:42:37.490866 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:42:37.500585 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:07.495364 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:17.503752 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:30.522231 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:43:30.522869 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:43:30.547534 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:43:30.575785 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:43:37.510197 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:57.506566 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:43:57.509845 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:44:17.508025 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:44:30.523707 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:44:30.524823 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:44:30.554974 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:44:30.579221 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:44:37.508931 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:44:57.504306 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:17.501792 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:30.524462 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:45:30.525226 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:45:30.556097 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:45:30.590313 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:45:37.506944 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:45:47.522689 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:46:07.521116 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:46:17.535330 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:46:27.535684 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:46:30.526217 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:46:30.528151 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:46:30.561660 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:46:30.585942 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:46:57.536369 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:46:57.542267 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:47:30.531543 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:47:30.532701 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:47:30.567080 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:47:30.591021 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:47:37.533154 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=1,cinder:SELECT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:47:37.534090 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:48:07.545490 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:48:07.557175 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:48:27.562214 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:48:30.536801 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:48:30.537872 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:48:30.567843 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:48:30.592500 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:48:47.560892 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:07.561263 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:17.559796 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:27.567385 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:49:30.538627 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:49:30.539294 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:49:30.566661 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:49:30.592055 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:49:47.560150 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:07.568629 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:17.575619 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:30.537464 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:50:30.538260 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:50:30.565891 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:50:30.589576 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:50:37.574289 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:57.572111 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:50:57.576423 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:17.578987 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:30.534784 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:51:30.535686 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:51:30.565295 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:51:30.605476 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:51:37.580745 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:51:57.591787 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:17.574792 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:30.531865 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:52:30.532551 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:52:30.586803 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:52:30.633290 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:52:37.578302 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:47.587727 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:52:57.595993 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:53:17.599590 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:53:27.613271 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:53:30.533497 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:53:30.534593 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:53:30.566013 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:53:30.595595 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:53:47.612043 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:53:57.617026 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:54:17.618935 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:54:30.532065 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:54:30.533964 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:54:30.561608 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:54:30.585914 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:54:37.612887 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:54:57.618240 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:55:07.625771 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:55:30.532265 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:55:30.533990 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:55:30.562611 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:55:30.586176 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:55:37.625557 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:55:47.638195 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:56:17.636951 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:56:17.639602 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:56:30.532005 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:56:30.533077 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:56:30.561217 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:56:30.585263 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:56:57.643686 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:56:57.644767 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:07.653558 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:27.650104 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:57:30.530889 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:57:30.532373 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:57:30.559181 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:57:30.584247 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:57:37.642288 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:58:07.642962 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:58:07.655370 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:58:27.653095 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:58:29.424846 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 21:58:29.444080 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Flow 'volume_create_manager' (ccb52703-361a-4a20-ab2b-8a094ff64a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:58:29.450092 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cd95ff-0927-4385-b1d8-7e4585359ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:58:29.467750 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cd95ff-0927-4385-b1d8-7e4585359ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T21:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-986155138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e6e7bd9a-7612-4fa7-a406-9bde82990183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17135327e2d14c4bbe4c7b242f9fda48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T21:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T21:58:29Z,use_quota=True,user_id='ce1a4da366004680b7330a8e9f43f945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:58:29.473011 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b61a20a-90bf-4017-b5e1-3019d185455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:58:29.476878 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b61a20a-90bf-4017-b5e1-3019d185455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:58:29.481630 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cb57da-d0b0-4622-849d-9eb13dc3955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:58:29.485509 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cb57da-d0b0-4622-849d-9eb13dc3955f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e7bd9a-7612-4fa7-a406-9bde82990183', 'volume_name': 'volume-e6e7bd9a-7612-4fa7-a406-9bde82990183', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:58:29.490134 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c86a51-4ec5-4cd1-b4be-cdfeca9c4205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:58:29.493788 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c86a51-4ec5-4cd1-b4be-cdfeca9c4205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:58:29.498229 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7d6f0a-43f9-456b-bee2-1181588a351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:58:29.499277 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Volume e6e7bd9a-7612-4fa7-a406-9bde82990183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e7bd9a-7612-4fa7-a406-9bde82990183', 'volume_size': 1} Oct 22 21:58:29.499690 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] creating volume 'volume-e6e7bd9a-7612-4fa7-a406-9bde82990183' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 21:58:29.500440 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:58:29.562167 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 21:58:29.562645 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 21:58:29.568526 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7d6f0a-43f9-456b-bee2-1181588a351e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e7bd9a-7612-4fa7-a406-9bde82990183', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:58:29.575398 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4a8a1c-1bb2-4c9c-bd87-ad9093a6538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 21:58:29.589427 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Volume volume-e6e7bd9a-7612-4fa7-a406-9bde82990183 (e6e7bd9a-7612-4fa7-a406-9bde82990183): created successfully Oct 22 21:58:29.593232 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4a8a1c-1bb2-4c9c-bd87-ad9093a6538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 21:58:29.598347 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Flow 'volume_create_manager' (ccb52703-361a-4a20-ab2b-8a094ff64a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 21:58:29.607986 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-626c3f3d-ef51-412c-a83e-7485b231a55f tempest-ServerActionsTestJSON-1985295999 None] Created volume successfully. Oct 22 21:58:30.528956 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:58:30.529621 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:58:30.560543 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:58:30.588274 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:58:31.121880 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-558e39df-f82b-4e6f-81af-3e8c7962341b req-1f4dda10-b653-431f-936c-349a4bd4f4a3 tempest-ServerActionsTestJSON-1985295999 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:58:31.871294 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-558e39df-f82b-4e6f-81af-3e8c7962341b req-1f4dda10-b653-431f-936c-349a4bd4f4a3 tempest-ServerActionsTestJSON-1985295999 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.749s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:58:31.872174 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-558e39df-f82b-4e6f-81af-3e8c7962341b req-1f4dda10-b653-431f-936c-349a4bd4f4a3 tempest-ServerActionsTestJSON-1985295999 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e6e7bd9a-7612-4fa7-a406-9bde82990183', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'e6e7bd9a-7612-4fa7-a406-9bde82990183', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:58:31.899554 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-558e39df-f82b-4e6f-81af-3e8c7962341b req-1f4dda10-b653-431f-936c-349a4bd4f4a3 tempest-ServerActionsTestJSON-1985295999 None] Connection info returned from driver {'name': 'volumes/volume-e6e7bd9a-7612-4fa7-a406-9bde82990183', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e6e7bd9a-7612-4fa7-a406-9bde82990183', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '85d06855-277d-4e10-9655-373acbe0eed0'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:58:31.950436 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-558e39df-f82b-4e6f-81af-3e8c7962341b req-1f4dda10-b653-431f-936c-349a4bd4f4a3 tempest-ServerActionsTestJSON-1985295999 None] attachment_update completed successfully. Oct 22 21:58:54.283277 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:58:54.295678 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-b8216ed4-33b2-4a2b-953b-564e23cfd889 req-2fb5daac-1f80-421b-a2e6-9d8a569e079a tempest-ServerActionsTestJSON-1985295999 None] Terminate volume connection completed successfully. Oct 22 21:58:54.296170 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-b8216ed4-33b2-4a2b-953b-564e23cfd889 req-2fb5daac-1f80-421b-a2e6-9d8a569e079a tempest-ServerActionsTestJSON-1985295999 None] Deleting attachment 85d06855-277d-4e10-9655-373acbe0eed0. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:58:56.516400 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-b8216ed4-33b2-4a2b-953b-564e23cfd889 req-9130a81a-344d-4d4b-b72c-02cdd4e29764 tempest-ServerActionsTestJSON-1985295999 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:58:57.257788 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-b8216ed4-33b2-4a2b-953b-564e23cfd889 req-9130a81a-344d-4d4b-b72c-02cdd4e29764 tempest-ServerActionsTestJSON-1985295999 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.741s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:58:57.258904 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-b8216ed4-33b2-4a2b-953b-564e23cfd889 req-9130a81a-344d-4d4b-b72c-02cdd4e29764 tempest-ServerActionsTestJSON-1985295999 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e6e7bd9a-7612-4fa7-a406-9bde82990183', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'e6e7bd9a-7612-4fa7-a406-9bde82990183', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:58:57.286842 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-b8216ed4-33b2-4a2b-953b-564e23cfd889 req-9130a81a-344d-4d4b-b72c-02cdd4e29764 tempest-ServerActionsTestJSON-1985295999 None] Connection info returned from driver {'name': 'volumes/volume-e6e7bd9a-7612-4fa7-a406-9bde82990183', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e6e7bd9a-7612-4fa7-a406-9bde82990183', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3a9ce41d-d8fa-4925-a46a-e698b78a60d1'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:58:57.342949 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-b8216ed4-33b2-4a2b-953b-564e23cfd889 req-9130a81a-344d-4d4b-b72c-02cdd4e29764 tempest-ServerActionsTestJSON-1985295999 None] attachment_update completed successfully. Oct 22 21:59:06.006561 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=36,cinder:UPDATE=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:06.011129 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-55459375-79f6-4727-9ff2-b8abdd880e62 req-1bd2ca62-b35d-46f5-9c2d-2c93d35546f9 tempest-ServerActionsTestJSON-1985295999 None] Terminate volume connection completed successfully. Oct 22 21:59:06.011583 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-55459375-79f6-4727-9ff2-b8abdd880e62 req-1bd2ca62-b35d-46f5-9c2d-2c93d35546f9 tempest-ServerActionsTestJSON-1985295999 None] Deleting attachment 3a9ce41d-d8fa-4925-a46a-e698b78a60d1. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:59:08.923955 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-55459375-79f6-4727-9ff2-b8abdd880e62 req-f9b193d3-8c29-46d6-bf7e-d8e13947a763 tempest-ServerActionsTestJSON-1985295999 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 21:59:09.669908 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-55459375-79f6-4727-9ff2-b8abdd880e62 req-f9b193d3-8c29-46d6-bf7e-d8e13947a763 tempest-ServerActionsTestJSON-1985295999 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.746s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 21:59:09.671365 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-55459375-79f6-4727-9ff2-b8abdd880e62 req-f9b193d3-8c29-46d6-bf7e-d8e13947a763 tempest-ServerActionsTestJSON-1985295999 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e6e7bd9a-7612-4fa7-a406-9bde82990183', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'e6e7bd9a-7612-4fa7-a406-9bde82990183', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 21:59:09.700270 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-55459375-79f6-4727-9ff2-b8abdd880e62 req-f9b193d3-8c29-46d6-bf7e-d8e13947a763 tempest-ServerActionsTestJSON-1985295999 None] Connection info returned from driver {'name': 'volumes/volume-e6e7bd9a-7612-4fa7-a406-9bde82990183', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e6e7bd9a-7612-4fa7-a406-9bde82990183', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd1096a8e-3bf4-423b-be4f-dbdf2198f8a1'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 21:59:09.752477 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-55459375-79f6-4727-9ff2-b8abdd880e62 req-f9b193d3-8c29-46d6-bf7e-d8e13947a763 tempest-ServerActionsTestJSON-1985295999 None] attachment_update completed successfully. Oct 22 21:59:16.847460 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-2277fca3-5c3d-427f-ab9b-97261a067b88 req-84a58a0c-5d35-4895-8651-06bac3d8c269 tempest-ServerActionsTestJSON-1985295999 None] Terminate volume connection completed successfully. Oct 22 21:59:16.848407 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-2277fca3-5c3d-427f-ab9b-97261a067b88 req-84a58a0c-5d35-4895-8651-06bac3d8c269 tempest-ServerActionsTestJSON-1985295999 None] Deleting attachment d1096a8e-3bf4-423b-be4f-dbdf2198f8a1. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 21:59:17.848886 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] Acquiring lock "cinder-e6e7bd9a-7612-4fa7-a406-9bde82990183-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 21:59:17.861773 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] Lock "cinder-e6e7bd9a-7612-4fa7-a406-9bde82990183-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 21:59:17.899687 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:59:17.948206 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 21:59:17.948689 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] Volume volume-e6e7bd9a-7612-4fa7-a406-9bde82990183 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 21:59:17.956136 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] deleting rbd volume volume-e6e7bd9a-7612-4fa7-a406-9bde82990183 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 21:59:18.162981 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] Created reservations ['d5b211c3-3ab2-468b-accc-965ecfa91262', 'ee4e1b71-baf0-4da7-9b36-d52f940d0c09', '1c10ff62-011f-4658-9b3c-76847192306b', 'e789f784-c28d-4764-a8ec-1393b0862e65'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 21:59:18.212305 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:59:18.239796 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:59:18.266353 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:59:18.270678 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] Deleted volume successfully. Oct 22 21:59:18.285279 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-70f04e87-809a-463c-9393-4484d107e26f tempest-ServerActionsTestJSON-1985295999 None] Lock "cinder-e6e7bd9a-7612-4fa7-a406-9bde82990183-delete_volume" released by "delete_volume" :: held 0.424s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 21:59:27.674782 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=41,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 21:59:30.533688 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 21:59:30.534339 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:59:30.567768 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 21:59:30.615162 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 21:59:37.665290 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=33,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:00:07.660238 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:00:17.660547 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:00:30.530653 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:00:30.531299 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:00:30.576021 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:00:30.628798 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:00:37.657007 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:00:37.680719 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:01:04.645113 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 22:01:04.664807 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Flow 'volume_create_manager' (bc7906a0-9d8f-42b1-a661-7abba2225c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 22:01:04.671197 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c93c49d-3066-4cb3-a6cc-4dd6acddcf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:01:04.688789 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c93c49d-3066-4cb3-a6cc-4dd6acddcf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T22:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-489991454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c149a5fd-4d51-459c-80f2-03423713f913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa75a4498a814ecc86698d0ddac01c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T22:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T22:01:05Z,use_quota=True,user_id='9adcc8a95203462ea78164d4db440351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:01:04.693881 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e108460-4331-4f34-b79f-bc8c08849f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:01:04.697761 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e108460-4331-4f34-b79f-bc8c08849f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:01:04.702477 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c044c06a-4b95-44e1-8165-bd61f5bcb6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:01:04.706555 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c044c06a-4b95-44e1-8165-bd61f5bcb6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c149a5fd-4d51-459c-80f2-03423713f913', 'volume_name': 'volume-c149a5fd-4d51-459c-80f2-03423713f913', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:01:04.711178 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf13dfe3-5450-496f-b7fc-78ab61394a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:01:04.714816 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf13dfe3-5450-496f-b7fc-78ab61394a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:01:04.719553 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa2450c-0323-4f75-abcc-77d9b50db21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:01:04.720565 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Volume c149a5fd-4d51-459c-80f2-03423713f913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c149a5fd-4d51-459c-80f2-03423713f913', 'volume_size': 1} Oct 22 22:01:04.720996 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] creating volume 'volume-c149a5fd-4d51-459c-80f2-03423713f913' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 22:01:04.721755 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:01:04.857219 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 22:01:04.857518 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 22:01:04.861112 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa2450c-0323-4f75-abcc-77d9b50db21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c149a5fd-4d51-459c-80f2-03423713f913', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:01:04.865683 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020e002f-a3a1-4d35-8459-6e86423296da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:01:04.877547 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Volume volume-c149a5fd-4d51-459c-80f2-03423713f913 (c149a5fd-4d51-459c-80f2-03423713f913): created successfully Oct 22 22:01:04.880835 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020e002f-a3a1-4d35-8459-6e86423296da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:01:04.885986 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Flow 'volume_create_manager' (bc7906a0-9d8f-42b1-a661-7abba2225c1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 22:01:04.896256 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-9d0ab7bf-539d-4ec6-b73b-dc7ed8005d74 tempest-TestMinimumBasicScenario-1689753837 None] Created volume successfully. Oct 22 22:01:06.306597 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 req-ec20895d-37ae-4987-a46c-8ba8b16f0b69 tempest-TestMinimumBasicScenario-1689753837 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 22:01:07.234015 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 req-ec20895d-37ae-4987-a46c-8ba8b16f0b69 tempest-TestMinimumBasicScenario-1689753837 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.927s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 22:01:07.234801 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 req-ec20895d-37ae-4987-a46c-8ba8b16f0b69 tempest-TestMinimumBasicScenario-1689753837 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c149a5fd-4d51-459c-80f2-03423713f913', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': 'c149a5fd-4d51-459c-80f2-03423713f913', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 22:01:07.270587 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 req-ec20895d-37ae-4987-a46c-8ba8b16f0b69 tempest-TestMinimumBasicScenario-1689753837 None] Connection info returned from driver {'name': 'volumes/volume-c149a5fd-4d51-459c-80f2-03423713f913', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c149a5fd-4d51-459c-80f2-03423713f913', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e000a680-3434-463f-9feb-d82ea10fe237'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 22:01:07.322504 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-4d0352a4-cf9c-4dcb-b9f6-9cf91a0b9bc5 req-ec20895d-37ae-4987-a46c-8ba8b16f0b69 tempest-TestMinimumBasicScenario-1689753837 None] attachment_update completed successfully. Oct 22 22:01:09.657679 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=6,cinder:SELECT=19,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:01:09.659683 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=21,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:01:09.690552 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-395db5bf-fa29-4bc7-bb5b-e32078e49621 tempest-TestMinimumBasicScenario-1689753837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:01:10.640882 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-395db5bf-fa29-4bc7-bb5b-e32078e49621 tempest-TestMinimumBasicScenario-1689753837 None] Create snapshot completed successfully Oct 22 22:01:30.535807 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:01:30.536590 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:01:30.568943 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:01:30.600795 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:01:47.653440 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:01:47.657575 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:DELETE=1,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:01:57.667113 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:02:27.656016 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:02:30.536201 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:02:30.537329 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:02:30.565228 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:02:30.589759 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:02:37.658041 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:02:57.660352 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:03:07.656767 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:03:30.535936 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:03:30.537089 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:03:30.572867 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:03:30.604577 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:03:36.564347 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e719ee7c-e039-456b-94e8-96ac74745288 tempest-TestMinimumBasicScenario-1689753837 None] Acquiring lock "cinder-12dd2170-cb4f-46fe-a148-7b97c7b53086-delete_snapshot" by "delete_snapshot" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 22:03:36.573446 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e719ee7c-e039-456b-94e8-96ac74745288 tempest-TestMinimumBasicScenario-1689753837 None] Lock "cinder-12dd2170-cb4f-46fe-a148-7b97c7b53086-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 22:03:36.574931 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-e719ee7c-e039-456b-94e8-96ac74745288 tempest-TestMinimumBasicScenario-1689753837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:03:37.650313 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:03:47.648926 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:04:06.714256 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-e719ee7c-e039-456b-94e8-96ac74745288 tempest-TestMinimumBasicScenario-1689753837 None] Created reservations ['d1d1b394-62e3-48b3-a1a5-09bc822ad778', '9fd65a0e-755a-4f63-98dd-558a8ac175a3', 'fbc7d4aa-b0fb-4581-a43f-2e38d2d243b4', '279d02a5-f3f4-4f99-a250-b4edd8f37528'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 22:04:06.753285 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-e719ee7c-e039-456b-94e8-96ac74745288 tempest-TestMinimumBasicScenario-1689753837 None] Delete snapshot completed successfully. Oct 22 22:04:06.758735 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-e719ee7c-e039-456b-94e8-96ac74745288 tempest-TestMinimumBasicScenario-1689753837 None] Lock "cinder-12dd2170-cb4f-46fe-a148-7b97c7b53086-delete_snapshot" released by "delete_snapshot" :: held 30.185s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 22:04:17.644683 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=19,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:04:27.651651 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=8,cinder:SELECT=11,cinder:INSERT=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:04:30.540217 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:04:30.541482 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:04:30.569494 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:04:30.594329 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:04:37.655524 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:04:57.652389 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:05:17.654410 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:05:30.539247 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:05:30.540478 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:05:30.574677 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:05:30.598812 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:05:37.650164 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:05:43.069556 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-77707ddc-f675-47bd-8089-dedb30a88e37 req-874d1445-8020-4228-8c2f-37047597c7f1 tempest-TestMinimumBasicScenario-1689753837 None] Terminate volume connection completed successfully. Oct 22 22:05:43.070111 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-77707ddc-f675-47bd-8089-dedb30a88e37 req-874d1445-8020-4228-8c2f-37047597c7f1 tempest-TestMinimumBasicScenario-1689753837 None] Deleting attachment e000a680-3434-463f-9feb-d82ea10fe237. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 22:05:43.666944 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] Acquiring lock "cinder-c149a5fd-4d51-459c-80f2-03423713f913-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 22:05:43.677474 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] Lock "cinder-c149a5fd-4d51-459c-80f2-03423713f913-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 22:05:43.711655 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:05:43.755392 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 22:05:43.755957 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] Volume volume-c149a5fd-4d51-459c-80f2-03423713f913 is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 22:05:43.763210 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] deleting rbd volume volume-c149a5fd-4d51-459c-80f2-03423713f913 {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 22:05:43.967733 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] Created reservations ['8fed593d-72de-424d-a473-588368623b36', '4c2177c4-dd5e-4536-921d-5dd54c6586e4', 'a6f437c5-40c3-492f-a411-ecce04567bc3', '718163c4-e5d8-4920-a485-401afe9e9ab0'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 22:05:44.015850 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:05:44.040958 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:05:44.068095 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:05:44.072173 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] Deleted volume successfully. Oct 22 22:05:44.088501 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-c6de39ee-84b6-48d5-ae6b-5c234f522752 tempest-TestMinimumBasicScenario-1689753837 None] Lock "cinder-c149a5fd-4d51-459c-80f2-03423713f913-delete_volume" released by "delete_volume" :: held 0.411s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 22:05:57.652131 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=20,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:06:17.651116 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=20,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:06:20.589939 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 22:06:20.611476 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Flow 'volume_create_manager' (6102b7b6-6777-4756-b572-df00b7265ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 22:06:20.617768 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2dcc61-5e25-47b8-bd49-9343fa7b7028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:06:20.663735 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2dcc61-5e25-47b8-bd49-9343fa7b7028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T22:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1842855155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=84e9205b-2498-48cc-a7ff-baf3221bc72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa75a4498a814ecc86698d0ddac01c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T22:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T22:06:21Z,use_quota=True,user_id='9adcc8a95203462ea78164d4db440351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:06:20.665128 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643cabab-b97c-45df-9a58-9bec9e6ad44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:06:20.668283 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643cabab-b97c-45df-9a58-9bec9e6ad44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:06:20.673021 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c493b7-e810-4bcb-b070-4a4a0c4946a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:06:20.677020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c493b7-e810-4bcb-b070-4a4a0c4946a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84e9205b-2498-48cc-a7ff-baf3221bc72d', 'volume_name': 'volume-84e9205b-2498-48cc-a7ff-baf3221bc72d', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:06:20.681625 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fe2f3e-4b2e-46b0-b5a8-0cb27167219a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:06:20.685317 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fe2f3e-4b2e-46b0-b5a8-0cb27167219a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:06:20.689745 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42761fe5-79d5-4b9e-b7c9-6def6a8f26eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:06:20.690784 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Volume 84e9205b-2498-48cc-a7ff-baf3221bc72d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84e9205b-2498-48cc-a7ff-baf3221bc72d', 'volume_size': 1} Oct 22 22:06:20.691178 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] creating volume 'volume-84e9205b-2498-48cc-a7ff-baf3221bc72d' {{(pid=131630) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}} Oct 22 22:06:20.691990 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:06:20.764726 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 22:06:20.765047 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 22:06:20.768833 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42761fe5-79d5-4b9e-b7c9-6def6a8f26eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e9205b-2498-48cc-a7ff-baf3221bc72d', 'volume_size': 1}' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:06:20.773216 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8883858-e0b1-4d7a-8b9a-f3433f503406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:06:20.785587 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Volume volume-84e9205b-2498-48cc-a7ff-baf3221bc72d (84e9205b-2498-48cc-a7ff-baf3221bc72d): created successfully Oct 22 22:06:20.789134 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8883858-e0b1-4d7a-8b9a-f3433f503406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:06:20.794298 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Flow 'volume_create_manager' (6102b7b6-6777-4756-b572-df00b7265ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 22:06:20.804211 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-1a5fcaa7-7662-4c21-92eb-70db8279f6c5 tempest-TestMinimumBasicScenario-1689753837 None] Created volume successfully. Oct 22 22:06:22.256508 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 req-0556b130-aab7-45ff-9352-f256f70ee5c8 tempest-TestMinimumBasicScenario-1689753837 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 22:06:23.103545 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 req-0556b130-aab7-45ff-9352-f256f70ee5c8 tempest-TestMinimumBasicScenario-1689753837 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.846s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 22:06:23.104805 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 req-0556b130-aab7-45ff-9352-f256f70ee5c8 tempest-TestMinimumBasicScenario-1689753837 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-84e9205b-2498-48cc-a7ff-baf3221bc72d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '84e9205b-2498-48cc-a7ff-baf3221bc72d', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 22:06:23.134530 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 req-0556b130-aab7-45ff-9352-f256f70ee5c8 tempest-TestMinimumBasicScenario-1689753837 None] Connection info returned from driver {'name': 'volumes/volume-84e9205b-2498-48cc-a7ff-baf3221bc72d', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '84e9205b-2498-48cc-a7ff-baf3221bc72d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '99cd98ac-2852-48e5-8460-07adbdf90739'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 22:06:23.186322 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-ea492a8f-764e-46a7-8e4c-1221e14a3d34 req-0556b130-aab7-45ff-9352-f256f70ee5c8 tempest-TestMinimumBasicScenario-1689753837 None] attachment_update completed successfully. Oct 22 22:06:30.544057 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:06:30.545402 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:06:30.581627 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:06:30.606245 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:06:37.645506 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=18,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:06:47.653416 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=21,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:07:17.639481 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:07:27.637712 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:07:30.541543 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:07:30.542202 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:07:30.571054 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:07:30.598192 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:07:57.636879 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:07:57.638116 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:08:30.543286 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:08:30.544781 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:08:30.581807 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:08:30.606993 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:08:37.632335 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:08:37.633538 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:08:44.813572 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-2048c39b-0033-44bc-b0d2-c50ece52c99d req-a0c9d179-a9f0-4b49-8480-0494a1f11e47 tempest-TestMinimumBasicScenario-1689753837 None] Terminate volume connection completed successfully. Oct 22 22:08:44.814938 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-2048c39b-0033-44bc-b0d2-c50ece52c99d req-a0c9d179-a9f0-4b49-8480-0494a1f11e47 tempest-TestMinimumBasicScenario-1689753837 None] Deleting attachment 99cd98ac-2852-48e5-8460-07adbdf90739. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 22:08:45.398079 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] Acquiring lock "cinder-84e9205b-2498-48cc-a7ff-baf3221bc72d-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 22:08:45.410231 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] Lock "cinder-84e9205b-2498-48cc-a7ff-baf3221bc72d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 22:08:45.451791 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:08:45.495022 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 22:08:45.495523 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] Volume volume-84e9205b-2498-48cc-a7ff-baf3221bc72d is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 22:08:45.500671 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] deleting rbd volume volume-84e9205b-2498-48cc-a7ff-baf3221bc72d {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 22:08:45.715126 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] Created reservations ['7abe2b80-db75-46db-9186-7c9610c1abef', '6e3b443d-22f4-4d8b-92d7-8452f7999f4e', 'f433299d-be77-4f5a-b431-62119da6916b', '00ed354d-8c44-441d-955e-944361506d51'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 22:08:45.766449 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:08:45.790859 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:08:45.814756 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:08:45.818872 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] Deleted volume successfully. Oct 22 22:08:45.839018 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-4a078b08-61fb-4933-882c-b363e500b08c tempest-TestMinimumBasicScenario-1689753837 None] Lock "cinder-84e9205b-2498-48cc-a7ff-baf3221bc72d-delete_volume" released by "delete_volume" :: held 0.429s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 22:09:07.650297 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:07.657550 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=19,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:30.542185 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:09:30.543618 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:09:30.572219 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:09:30.597098 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:09:47.639370 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:09:47.641600 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=4,cinder:SELECT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:17.651721 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:17.655847 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:30.542434 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:10:30.543138 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:10:30.572014 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:10:30.598226 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:10:37.648961 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:10:47.659685 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:11:17.638761 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:11:27.637170 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:11:30.545950 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:11:30.547031 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:11:30.580851 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:11:30.605370 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:11:57.633012 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:12:07.645667 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:12:27.648372 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:12:30.543324 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:12:30.544428 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:12:30.580946 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:12:30.604667 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:12:47.642746 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:13:07.646666 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:13:27.647054 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:13:30.540460 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:13:30.541262 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:13:30.571856 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:13:30.598210 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:13:47.639030 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=2,cinder:SELECT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:14:07.639246 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:14:27.632214 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:14:47.626383 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:07.623791 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:27.621993 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:27.633751 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:30.545741 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:15:30.546435 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:15:30.579871 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:15:30.614578 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:15:47.636809 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:15:57.633858 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:16:27.640812 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:16:30.552237 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:16:30.553702 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:16:30.585842 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:16:30.611163 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:16:37.627956 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:16:57.626426 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:17:17.630034 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:17:30.559173 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:17:30.560128 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:17:30.595500 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:17:30.619597 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:17:37.619997 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:17:57.618908 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:18:17.620433 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:18:27.632602 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:18:30.564357 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:18:30.565501 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:18:30.598817 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:18:30.623749 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:18:57.629147 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:07.625614 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:30.569351 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:19:30.571210 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:19:30.605167 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:19:30.630134 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:19:37.626933 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:19:47.635943 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:20:07.632171 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:20:17.632595 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:20:30.566291 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:20:30.566965 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:20:30.593641 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:20:30.618728 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:20:37.645615 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:20:57.642549 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:21:17.648272 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:21:30.564721 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:21:30.565769 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:21:30.598309 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:21:30.624839 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:21:37.638654 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:21:47.650419 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:17.641735 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:27.632566 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:30.570958 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:22:30.572667 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:22:30.607640 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:22:30.632057 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:22:47.634333 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:22:57.648934 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:23:27.637395 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:23:30.572935 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:23:30.573781 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:23:30.602296 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:23:30.626479 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:23:37.645803 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:23:57.648150 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:24:17.648360 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:24:27.659865 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:24:30.571704 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:24:30.572838 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:24:30.602346 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:24:30.627395 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:24:47.662623 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:07.631285 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:07.648423 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131630) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Oct 22 22:25:07.668348 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Flow 'volume_create_manager' (6c5ea213-f149-4453-babd-23c6780d75b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 22:25:07.674555 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db5e937-8a48-43e4-b24e-9a49cb4e4d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:25:07.693552 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db5e937-8a48-43e4-b24e-9a49cb4e4d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-10-22T22:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2110947749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3edfe8c6-0401-48df-9c79-34326927843b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0a5546dd7e4676b6e1ae44898972e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-22T22:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-22T22:25:08Z,use_quota=True,user_id='d12dda477f454a20aff297708f052dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dab03be6-f5a0-454c-bdd5-705b7c298774),volume_type_id=dab03be6-f5a0-454c-bdd5-705b7c298774)' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:25:07.698637 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d68cfe-c384-47ce-bfbd-6b708f2e6b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:25:07.702663 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d68cfe-c384-47ce-bfbd-6b708f2e6b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:25:07.707505 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ebb3e6-8e28-4ea3-81bd-d915fe5065dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:25:07.794204 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ebb3e6-8e28-4ea3-81bd-d915fe5065dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3edfe8c6-0401-48df-9c79-34326927843b', 'volume_name': 'volume-3edfe8c6-0401-48df-9c79-34326927843b', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:25:07.798960 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b567f80-958a-455e-a212-1d31e34ec2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:25:07.802705 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b567f80-958a-455e-a212-1d31e34ec2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:25:07.807133 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e57db4-23a1-4148-a60a-8909fb103429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:25:07.808246 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Volume 3edfe8c6-0401-48df-9c79-34326927843b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3edfe8c6-0401-48df-9c79-34326927843b', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Oct 22 22:25:07.808886 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Cloning 3edfe8c6-0401-48df-9c79-34326927843b from image 085e4478-6edc-4a69-8e08-f9831713eb65 at location (None, None). {{(pid=131630) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Oct 22 22:25:07.809649 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Acquiring lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" by "_prepare_image_cache_entry" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 22:25:07.817914 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 22:25:07.830769 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 22, 25, 7, 822742)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 22:25:07.831286 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 22:25:07.831709 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Found cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Oct 22 22:25:07.836050 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Lock "cinder-085e4478-6edc-4a69-8e08-f9831713eb65" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 22:25:07.837001 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Attempting to retrieve cache entry for image = 085e4478-6edc-4a69-8e08-f9831713eb65 on host ncdv-master-1@ceph#ceph. {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Oct 22 22:25:07.843294 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Found image-volume cache entry: {'id': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'volume_id': '3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38), 'last_used': datetime.datetime(2022, 10, 22, 22, 25, 7, 840892)}. {{(pid=131630) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Oct 22 22:25:07.843842 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.image.cache [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Image-volume cache entry image_update_at = 2022-10-22 20:39:38+00:00, requested image updated_at = 2022-10-22 20:39:38+00:00. {{(pid=131630) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Oct 22 22:25:07.844238 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Creating from source image-volume 3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf {{(pid=131630) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Oct 22 22:25:07.856363 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:25:07.916075 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] creating snapshot='volume-3edfe8c6-0401-48df-9c79-34326927843b.clone_snap' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}} Oct 22 22:25:08.084898 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] cloning 'volume-3c6d606b-ff11-4b7e-8658-c4bdb1d0e9cf@volume-3edfe8c6-0401-48df-9c79-34326927843b.clone_snap' to 'volume-3edfe8c6-0401-48df-9c79-34326927843b' {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}} Oct 22 22:25:08.216362 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Volume volume-b19f74cf-0ef6-4650-adc9-cd75d82fe224.deleted is not a clone. {{(pid=131630) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}} Oct 22 22:25:08.217612 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}} Oct 22 22:25:08.217983 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131630) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}} Oct 22 22:25:08.236162 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] clone created successfully {{(pid=131630) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}} Oct 22 22:25:08.236789 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.volume_utils [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Marking volume 3edfe8c6-0401-48df-9c79-34326927843b as bootable. {{(pid=131630) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Oct 22 22:25:08.245793 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Copying metadata from image 085e4478-6edc-4a69-8e08-f9831713eb65 to 3edfe8c6-0401-48df-9c79-34326927843b. {{(pid=131630) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Oct 22 22:25:08.246227 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Creating volume glance metadata for volume 3edfe8c6-0401-48df-9c79-34326927843b backed by image 085e4478-6edc-4a69-8e08-f9831713eb65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131630) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Oct 22 22:25:08.301427 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e57db4-23a1-4148-a60a-8909fb103429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3edfe8c6-0401-48df-9c79-34326927843b', 'volume_size': 1, 'image_id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ffd1cedd62c48f599340661b26417f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '085e4478-6edc-4a69-8e08-f9831713eb65', 'created_at': datetime.datetime(2022, 10, 22, 20, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 22, 20, 39, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/085e4478-6edc-4a69-8e08-f9831713eb65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:25:08.305766 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa3162f-2661-4227-b573-f23bc0dc4446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Oct 22 22:25:08.316524 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.flows.manager.create_volume [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Volume volume-3edfe8c6-0401-48df-9c79-34326927843b (3edfe8c6-0401-48df-9c79-34326927843b): created successfully Oct 22 22:25:08.319843 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa3162f-2661-4227-b573-f23bc0dc4446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131630) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Oct 22 22:25:08.325010 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Flow 'volume_create_manager' (6c5ea213-f149-4453-babd-23c6780d75b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131630) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Oct 22 22:25:08.334108 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [None req-df6caea9-2eca-404f-9068-e6dd3675f4d2 tempest-TestShelveInstance-1901158978 None] Created volume successfully. Oct 22 22:25:10.900928 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-5dcd88dd-9847-4425-8652-5f9e48a736dd req-3106d4be-217e-4d6c-a25d-71af36f32dda tempest-TestShelveInstance-1901158978 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 22:25:11.684434 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-5dcd88dd-9847-4425-8652-5f9e48a736dd req-3106d4be-217e-4d6c-a25d-71af36f32dda tempest-TestShelveInstance-1901158978 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.783s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 22:25:11.685333 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-5dcd88dd-9847-4425-8652-5f9e48a736dd req-3106d4be-217e-4d6c-a25d-71af36f32dda tempest-TestShelveInstance-1901158978 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3edfe8c6-0401-48df-9c79-34326927843b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '3edfe8c6-0401-48df-9c79-34326927843b', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 22:25:11.715744 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-5dcd88dd-9847-4425-8652-5f9e48a736dd req-3106d4be-217e-4d6c-a25d-71af36f32dda tempest-TestShelveInstance-1901158978 None] Connection info returned from driver {'name': 'volumes/volume-3edfe8c6-0401-48df-9c79-34326927843b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3edfe8c6-0401-48df-9c79-34326927843b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '811da9e6-5921-4879-834f-ca1e8a262bd3'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 22:25:11.784007 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-5dcd88dd-9847-4425-8652-5f9e48a736dd req-3106d4be-217e-4d6c-a25d-71af36f32dda tempest-TestShelveInstance-1901158978 None] attachment_update completed successfully. Oct 22 22:25:17.684905 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=31,cinder:UPDATE=4,cinder:INSERT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:30.572317 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:25:30.573727 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:25:30.606109 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:25:30.632746 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:25:37.682252 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=29,cinder:UPDATE=8,cinder:INSERT=7,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:37.684115 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:25:57.691026 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:26:07.694283 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:26:30.568851 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:26:30.569559 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:26:30.597272 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:26:30.621828 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:26:37.681898 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:26:47.679785 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:27:17.671091 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:27:27.671405 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:27:30.568434 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:27:30.569707 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:27:30.601559 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:27:30.632877 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:27:50.851249 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:27:50.863245 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe req-533ce866-083e-437d-ae09-1a8fb1597c48 tempest-TestShelveInstance-1901158978 None] Terminate volume connection completed successfully. Oct 22 22:27:50.863689 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-41e5ccbf-34b8-4c19-9e42-eb90fc9ca8fe req-533ce866-083e-437d-ae09-1a8fb1597c48 tempest-TestShelveInstance-1901158978 None] Deleting attachment 811da9e6-5921-4879-834f-ca1e8a262bd3. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 22:27:52.363563 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-5d459b85-ac39-4a10-bc02-4510631cd4d2 req-84ec8ceb-129c-4a4a-84d6-d602814a81dc tempest-TestShelveInstance-1901158978 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 22:27:53.106075 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_concurrency.processutils [req-5d459b85-ac39-4a10-bc02-4510631cd4d2 req-84ec8ceb-129c-4a4a-84d6-d602814a81dc tempest-TestShelveInstance-1901158978 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.742s {{(pid=131630) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 22:27:53.107001 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-5d459b85-ac39-4a10-bc02-4510631cd4d2 req-84ec8ceb-129c-4a4a-84d6-d602814a81dc tempest-TestShelveInstance-1901158978 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3edfe8c6-0401-48df-9c79-34326927843b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '0c6c2c34-73f1-4f49-ac48-3a7235affc01', 'volume_id': '3edfe8c6-0401-48df-9c79-34326927843b', 'discard': True}} {{(pid=131630) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}} Oct 22 22:27:53.134549 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-5d459b85-ac39-4a10-bc02-4510631cd4d2 req-84ec8ceb-129c-4a4a-84d6-d602814a81dc tempest-TestShelveInstance-1901158978 None] Connection info returned from driver {'name': 'volumes/volume-3edfe8c6-0401-48df-9c79-34326927843b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3edfe8c6-0401-48df-9c79-34326927843b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '665be409-9f86-48b6-afc3-5ef89d7485ff'} {{(pid=131630) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Oct 22 22:27:53.189741 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-5d459b85-ac39-4a10-bc02-4510631cd4d2 req-84ec8ceb-129c-4a4a-84d6-d602814a81dc tempest-TestShelveInstance-1901158978 None] attachment_update completed successfully. Oct 22 22:28:07.672297 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=25,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:28:27.666582 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:28:30.572113 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:28:30.573426 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:28:30.609111 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:28:30.640077 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:28:47.666623 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:29:07.662909 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:29:27.659161 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:29:28.705383 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-1765330c-542c-4009-9b62-31781d627e47 req-6dce3ed5-ea75-4d3f-9618-1bc51467d5d4 tempest-TestShelveInstance-1901158978 None] Terminate volume connection completed successfully. Oct 22 22:29:28.705993 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.manager [req-1765330c-542c-4009-9b62-31781d627e47 req-6dce3ed5-ea75-4d3f-9618-1bc51467d5d4 tempest-TestShelveInstance-1901158978 None] Deleting attachment 665be409-9f86-48b6-afc3-5ef89d7485ff. {{(pid=131630) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Oct 22 22:29:28.827395 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] Acquiring lock "cinder-3edfe8c6-0401-48df-9c79-34326927843b-delete_volume" by "delete_volume" {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Oct 22 22:29:28.839713 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] Lock "cinder-3edfe8c6-0401-48df-9c79-34326927843b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Oct 22 22:29:28.884292 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:29:28.997916 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] volume has no backup snaps {{(pid=131630) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Oct 22 22:29:29.007327 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] deleting rbd volume volume-3edfe8c6-0401-48df-9c79-34326927843b {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}} Oct 22 22:29:29.262174 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] volume is a clone so cleaning references {{(pid=131630) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}} Oct 22 22:29:29.295462 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] deleting parent snapshot volume-3edfe8c6-0401-48df-9c79-34326927843b.clone_snap {{(pid=131630) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}} Oct 22 22:29:30.240668 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.quota [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] Created reservations ['4f2e56e1-2f7d-4d0f-8b16-125362c8e961', 'a00798f5-009a-48cc-a129-7f1ce00e76d7', 'a4fa23bb-67f8-470d-ad86-476e0e80bfa8', '5156b486-7376-449d-836d-5148c15e4225'] {{(pid=131630) reserve /opt/stack/cinder/cinder/quota.py:755}} Oct 22 22:29:30.306202 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:29:30.335863 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:29:30.365752 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:29:30.371631 ncdv-master-1 cinder-volume[131630]: INFO cinder.volume.manager [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] Deleted volume successfully. Oct 22 22:29:30.388625 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.coordination [req-1765330c-542c-4009-9b62-31781d627e47 req-39e719a8-1058-4f79-882b-1eda48fe21d8 tempest-TestShelveInstance-1901158978 None] Lock "cinder-3edfe8c6-0401-48df-9c79-34326927843b-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=131630) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Oct 22 22:29:30.576324 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:29:30.577065 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:29:30.604740 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:29:30.634879 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:29:47.665953 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=18,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:30:07.663188 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=21,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:30:27.658921 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:30:30.572864 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:30:30.573596 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:30:30.599708 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:30:30.625171 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:30:47.653334 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:31:07.652993 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:31:27.654037 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:31:30.570615 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:31:30.571431 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:31:30.596802 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:31:30.620914 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:31:47.660099 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:07.657486 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:17.672319 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:30.567685 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:32:30.568452 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:32:30.596626 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:32:30.624531 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:32:37.659715 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:57.653319 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:32:57.654304 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:33:27.661166 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:33:30.570846 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:33:30.572008 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:33:30.598236 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:33:30.628138 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:33:37.653929 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:07.651267 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:17.660288 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:30.574374 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:34:30.575438 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:34:30.603773 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:34:30.628036 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:34:47.655269 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:34:57.656308 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:35:27.654597 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:35:27.657186 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:35:30.574587 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:35:30.575565 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:35:30.608258 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:35:30.636601 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:36:07.651155 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:36:07.652751 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:36:30.572890 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:36:30.573775 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:36:30.600945 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:36:30.626864 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:36:47.646675 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:36:47.647787 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:37:17.650450 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:37:27.650864 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:37:30.572575 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:37:30.573536 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:37:30.603753 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:37:30.628561 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:37:47.660698 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:38:07.661103 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:38:27.655650 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:38:30.574382 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:38:30.575451 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:38:30.631328 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:38:30.665654 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:38:47.650024 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:39:07.654423 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:39:17.662431 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:39:30.570777 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:39:30.571478 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:39:30.597275 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:39:30.621436 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:39:47.656540 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:39:57.656794 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:40:27.659939 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:40:30.567197 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:40:30.567956 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:40:30.596028 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:40:30.621696 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:40:37.661839 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:41:07.652377 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:41:17.652538 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:41:27.661824 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:41:30.568749 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:41:30.569721 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:41:30.597760 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:41:30.621821 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:41:37.666950 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:41:57.659983 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:42:07.659272 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:42:30.568102 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:42:30.569020 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:42:30.596621 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:42:30.621040 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Oct 22 22:42:37.654708 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:42:47.658840 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:43:07.652575 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:43:27.657163 ncdv-master-1 cinder-volume[131630]: DEBUG dbcounter [-] [131630] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 22:43:30.569808 ncdv-master-1 cinder-volume[131630]: DEBUG oslo_service.periodic_task [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131630) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Oct 22 22:43:30.570488 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:43:30.596225 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.volume.drivers.rbd [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131630) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}} Oct 22 22:43:30.661348 ncdv-master-1 cinder-volume[131630]: DEBUG cinder.manager [None req-b997e711-fb34-48fd-846d-d33decc73dae None None] Notifying Schedulers of capabilities ... {{(pid=131630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}